Large fluctuations in multi-attractor systems 
and the generalized Kramers problem 



S M Soskin 

Institute of Semiconductor Physics, National Ukrainian Academy of Sciences, Kiev, Ukraine, 
Abstract 

The main subject of the paper is an escape from a muhi-well metastable potential on a 
time-scale of a formation of the quasi-equilibrium between the wells. The main attention 
is devoted to such ranges of friction in which an external saddle does not belong to a basin 
of attraction of an initial attractor. A complete rigorous analysis of the problem for the 
most probable escape path is presented and a corresponding escape rate is calculated with 
a logarithmic accuracy. Unlike a conventional rate for a quasi-stationary flux, the rate on 
shorter time-scales strongly depends on friction, moreover, it may undergo oscillations in 
the underdamped range and a cutoff in the overdamped range. 

A generalization of the results for inter-attractor transitions in stable potentials with 
more than two wells is also presented as well as a splitting procedure for a phenomeno- 
logical description of inter-attractor transitions is suggested. 

Applications to such problems as a dynamics of escape on time-scales shorter than 
an optimal fluctuation duration, prehistory problem, optimal control of fluctuations, fiuc- 
tuational transport in ratchets, escapes at a periodic driving and transitions in biased 
Josephson junctions and ionic channels are briefly discussed. 

KEY WORDS: large fluctuation, multi-attractor system, master equation, probability 
flux, flrst-passage problem, Kramers problem, variational problem, most probable direct 
transition path, action, detailed balance, time-reverse path, saddle connection. 



Chapter 1 
Introduction 



The problem of rare fluctuational transitions in a classical system driven by a weak noise 
attracts an attention of theorists for more than half a century (for a historical review see 
e.g. HI). Its treatment in a contemporary form should be counted probably from the 
celebrated work by Kramers Q in which, in particular, the noise-induced escape from a 
metastable potential well was considered. The principal result by Kramers is that, after 
a short initial period during which a quasi- stationary distribution formes within the well, 
the probability flux from it is an exponentially decaying function: 

J = ae-'^\ (1.1) 

where the escape rate a contains, appart from the Arrhenius factor 0| exp{—AU/T) {AU 
is a height of the potential barrier and T is a temperature) , a preexponential factor which 
relatively weakly depends on T, friction T and some details of a potential U{q) 

a = A(T,r,[f/])exp(-^), T«Af/, (1.2) 

and Kramers derived explicit asymptotic formulas for A in the ultra-underdamped and 

moderate-to-overdamped limits. 

I do not have a room here to review all developments and generalizations of the 
^In fact, there was an earlier work, by Pontryagin, Andronov and Vitt jsj, which forestaUed in many 
respects the Kramers paper, but it remained practically unknown for western scientists and, historically, 
has not influenced the development of science. 
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Kramers problem (surveys of the state of art, at least by the end of 80th, are given in 
major reviews ||5[, ]§]). Rather I shall mention just two activities which are quite relevant 
to the subject of my paper. 

One of them concerned the problem of filling the "gap" between the ultra-underdamped 
and moderate-to-overdamped limits for the expression of the preexponential factor A. 
This activity was crowned by the work by Melnikov (see also the review and ref- 
erences therein) who developed a very beautiful method based on the reduction of the 
Fokker-Plank equation, in the underdamped regime, to some more simple integral equa- 
tion which, in its turn, was solved by the Wiener-Hopf method. We draw attention of a 
reader to that fact that, in all friction ranges, a dependence of the escape rate on friction 
is much weaker than exponential 

However all these works considered only a quasi-stationary flux. A natural question 
is: how does an escape flux evolves from zero at the initial instant to its quasi- stationary 
value at time-scales greatly exceeding a time of a formation of the quasi-equilibrium within 
the metastable part of the potential? There were few works on this problem 0, 0, [|l^ 
but they all concerned only a single- well case: the quasi-equilibrium is established in this 
case quickly (for a time of the order of a characteristic relaxation time in the well). 

In contrast, the formation quasi-equilibrium in a multi-well metastable potential takes 
an exponentially longer time. Indeed, the formation has two essentially different stages in 
this case: the first stage, during which quasi-equilibrium forms within the initial well, is 
short (similar to that one in a single-well case) while the second stage, when an equilibrium 
between different wells forms, is exponentially longer. Escapes for these two stages occur 
quite differently. The present paper considers an escap^ flux just in the second stage. It 
should be emphasized that, at small temperatures, just this stage is most relavant to real 
situations since the first stage ends very quickly (its duration depends on temperature 
logarithmically while the second stage duration increases exponentially sharply as tem- 
perature decreases) while larger time-scales, related to the quasi- stationary stage, may 
exceed significantly an observation/experiment time. 

A duration of an escape/transition is typically much smaller than a time during which a 
^ A closely related problem of inter-well transitions in a multi-well stable potential is also considered. 
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system waits for the escape/transition |TT[ so that the transition process may be considered 
at the relevant time-scales as an instantaneous one while a noise-driven multi-stable system 



on the whole may be described as a Markov chain [|TI| i.e. within an approximation of 
master equations for populations of attractors, with constant transition rates aij between 
states i and j (attractors or an unstable region). 

Fig.l illustrates schematically an escape from a double- well metastable potential. If the 
system stays initially in 1 then, on time-scales preceding the formation quasi-equilibrium 
between wells 1 and 2, escapes occur most probable directly i.e. without relaxing into 
the bottom of the well 2, so that the flux at such time-scales is equal to ais which may 
drastically differ from the quasi-stationary flux. 

A rate of a transition/escape flux over more than one barrier, e.g. such as ais, cannot 
be generally described by the Melnikov method, as it was recognized yet by Melnikov 
himself . Instead, we use for their description the concept of optimal large fluctuation. 
Not only it provides a calculation of escape/transition rates but also allows to find a 
trajectory along which escapes/transitions occur with an overwhelming probability. The 
concept of optimal large fluctuation dates back to 50th-60th |T^-[|^ but the outburst 



of the interest to it falls onto the last decade which, apart from the logic of its own 
scientific development, is probably due to numerous recently appeared subjects related to 
large fluctuations and suggesting interesting applications in physics, biology, engineering, 
etc. These are first of all: stochastic resonance (see for recent reviews [|r3[, |TB| and 



references therein), noise- induced transport in ratchets (e.g. [0-[^), optimal control of 
fluctuations (e.g. p3[, @]). A few hundreds papers on these subjects have been pubhshed 
for the last decade. As concers the problem of large fluctuations itself, it was treated 
by various methods: direct probabilistic methods (see [|14|, [jlT| and references therein). 



eikonal approximation of the Fokker-Plank equation (e.g. ^5|-^9|) and the path-integral 



method (e.g. |20[-|Q, [^-|Q). Usually the primary aim of all these methods is to derive 
an exponent in the most strong (activation-like) factor in the dependence of a transition 
rate on temperature (or any other quantity characterizing noise intensity): 

' ~), T<^S, (1.3) 
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where 5* is an action of the Onsager-Muchlup type [|T2] taken along an optimal path of a 
fluctuational transition. For the escape from a single potential well, the most probable 
escape path is time-reverse to the relaxational trajectory from the saddle to the bottom 
of the well (see e.g. |2^) which obviously provides that same Arrhenius factor in (1.2). 
A corresponding noise realization is often called an optimal fluctuation ||34|| . 

In a multi-well relaxational trajectory from an external saddle may relax into a 

well different from an initial one. Then an optimal path qualitatively differs from that one 
in a single-well case. Some important results on optimal paths in this case and on action 



along them were obtained in p6|. However, apart from these results were obtained in a 
different context and by a method different from ours, they provided only a general type 
of a solution of the problem for the path while the further analysis was far not complete 
and based mostly on intuitive ideas rather than on a rigorous treatment: just an absence 
of such treatment gave rise to the encountered by authors of p6[ difficulties at numerical 
calculations. 

In contrast, a complete rigorous analysis of optimal paths and action along them is 
provided in the present work which has allowed in particular to find characteristic non- 
trivial features of an evolution of direct escape rate (such as 0:13) as friction F varies: 
unlike a conventional quasi-stationary flux, it may depend on F exponentially sharply, 
moreover, it may undergo oscillations in the range of small F and a cutoff at F exceeding 
certain value from the moderate-to-high friction range. The results for an escape flux 
are generalized for inter-attractor transitions in multi-well stable potentials, as well as 
applications to various other problems are discussed. 

For a convenience of readers, quite detailed description of a contents of each chapter 
of this quite long paper is provide below. 

A short Chapter 2 has mostly an introductory aim, presenting a general description of 
a transition/escape flux in a multi-attractor system by means of master equations. The 
only novelty in this chapter is an introduction of a splitting procedure allowing to resolve 
transitions by numbers of returns from a final state. 

The main part of the paper is concentrated in Chapter 5 which concerns escape/transition 
rates and related optimal paths in potential systems driven by a weak white noise and by a 
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linear friction of an arbitrary magnitude. The sub-section 3. 1 provides some very general 
estimations and conclusions based on the property of detailed balance. The sub-section 
3.2 presents in a general form a solution of the variational problem for the most probable 
direct transition path (MPDTP) for an arbitrary potential U{q) and an arbitrary friction 
parameter F. Main results of this sub-section are equivalent to the results of p6[ (obtained 
by a different method and in a different context). The central and the largest part of the 
paper is the sub-section 3.3: it presents the most interesting and non-trivial results of the 
paper. It consists of three parts. In the first part, 3.3.1, 1 formulate and prove 4 theorems 
which cover all possible types of MPDTPs relevant to the generalized Kramers problem 
(c.f. Fig.l). The second part, 3.3.2, concerns action 5* (related to aia) and illustrates 
its main features at some typical example, presenting an evolution of action as F varies. 
Finally, in the third part, 3.3.3, explicit asymptotic expressions for action and MPDTP 
are derived for the underdamped range (they describe in particular oscillations of 5'(F)). 

Chapter 4 discusses briefly applications to various problems: inter-well transition rates 
in a 3-well stable potential, dynamics of an escape/transition flux on time-scales less or 
of the order of the time of a formation quasi-equilibrium within an initial well, prehistory 
problem, optimal control of fluctuations, fiuctuational transport in ratchets, escapes at a 
periodic driving and transitions in biased Josephson junctions and ionic channels. 

A summary and acknowledgements are presented in Chapters 5 and 6 respectively. 

Appendix A illustrates the splitting procedure by an explicit description of higher-order 
partial probability fluxes in multi-stable systems. Appendix B describes the reduction of 
the Euler-Poisson equation for the MPDTP to some much more simple one. Appendix 
C analyses a possibility to sew together different extremals (solutions of the variational 
problem). Appendix D deals with the analysis of singularities in the solutions of the 
variational problem. 
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Chapter 2 

Phenomenological description of 
transitions in multi-stable systems 



Let us consider a dynamical system possessing more than one attractor. If a weak noise is 
added then one may formulate a problem of a fluctuational transition from a vicinity of a 
given initial attractor to a given final state which, generally speaking, may not belong to 
a basin of attraction of the initial attractor. It was shown in |TT| in a general form that. 



on a large time-scale, such system may be considered as a finite Markov chain in which an 
initially populated state corresponds to a given initial attractor of the dynamical system, a 
final state corresponds to a given final state of the transition while other states correspond 
to other attractors of the dynamical system. The possibility for this is provided by that 
fact that a duration of an optimal fluctuation is exponentially smaller than a waiting time 
of such fluctuation. This allows to describe the dynamics in terms of transition rates and 
populations of attractors satisfying certain differential master equations. 

For the sake of simplicity and clarity, we shall consider further, unless otherwise spec- 
ified, the case when only 3 states are involved: an initial, final and one intermediate state 
- i.e. we shall consider a transition either from one of attractors of a bistable system to 
a non- attractor, or between attractors in a system possessing 3 attractors. The gener- 
alization to a larger number of involved attractors is not difficult though the resulting 
expressions are more cumbersome. 

It will be assumed further in this Section that rates of direct transitions between the 
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states, ttij, are known (for potential systems subject to white noise and linear friction, 
such rates will be calculated with a logarithmic accuracy in Sec. 3). 

2.1. SPLITTING PROCEDURE AND FIRST-PASSAGE FLUX 

Let us introduce a probability of that the 3-state system being intially at the state 1 
arrives at the state 3 during an infinitesimal interval [t, t + dt]: dP{l 3, t). Equivalently, 
one may consider a probability flux 

,(i^3..)^;?^(i^. ,2,) 

The flux can be easily expressed via the populations Wi of the states and corresponding 
direct transition rates: 

J(l ^3,t) = «i3l^l+«23W^2, (2.2) 



while the populations obey conventional master equations [35|: 



(2.3) 

1,2,3, 

1, 1^2(0) = 0, W^3(0) = 

which can be easily solved. 

In the most of applications, a final state of a transition is some attractor and its 
vicinity rather than just some point in a phase space of a dynamical system. In this case, 
rates of transitions from the final state may be of the same order or larger than rates of 
transitions into the final state. Hence, the flux (2.1) accounts both for those realizations 
in which the system visits the final state at a given instant t for the first time and for 
those ones in which it already visited this state before t. In many cases, one does need to 
resolve such transitions: for example, in the mean first passage time problem, one needs 
to account only for first-time transitions into 3 while, in a prehistory problem, one needs 
to know the prehistory of the transition, in particular how many times the system visited 



dWj 

IT ~ 

hj = 

WAO) = 
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the state 3 before to arrive at it at the instant t. Then, one needs to spht the probabihty 
flux into the corresponding partial fluxes 



J(1^3,t) = 5: J(")(1^3,t), (2.4) 

n=l 

where J^'^\l 3,t) corresponds to such transition at which the system visited the state 
3 {n — 1) times before to arrive at it for the nth time at the instant t. 

In order to be able to calculate J^"'\l 3, t) one needs to introduce partial populations 
of states 1, 2 and 3, Wi'^\ W2^^ and W^'^^ respectively. Unlike conventional populations, 
these quantities satisfy the following condition: they account only for such realizations of 
noise at which the system entered the final state (i.e. the state 3) before a current instant 
t n — 1 times. Obviously, W^"'^ satisfy the sum relation 

oo 

W, = j:wt^. (2.5) 

n=l 

I shall consider further in this Section only the most important partial flux, J^^\ Note 
that, in the generalized Kramers problem, escape flux is equal to J^^^ identically. Thus 
the consideration below is equally relevant to stable and to metastable systems (in the 
latter term "state 3" means a state far beyond a metastable part of the system). 

The higher-order fluxes in a stable system are considered in the Appendix AQ. 

The dynamics of the first-order partial populations is governed with the following 
master equations Q 

= auWi'^ - (a,, + a2s)wi'\ (2.6) 
iy«(0) = l, wP{o) = o 

^Th.e splitting procedure is valid in particular for the simplest (and most frequently exploited) inter- 
attractor transition problem - in a bistable system. For the first-passage problem, the procedure does 
not lead in this case to new results since the first-passage problem in a bistable system is equivalent to 
an escape problem, which was solved before. However the results for highcr-order-passage problems are 
non-trivial which is also demonstrated in the Appendix A. 

^The partial population W^^\t) = 0, as it follows from its definition. 
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The system (2.6) is solved explicitly: 



W^^'^=Ci!!) = (S)e"^ + (-".?K^' (2-7) 



ai = {d — ai2 — ai3 + 0:21 + 023)/ {2d), = 012/ d, 

_ 2 _ 2 

ti — , tg — 

ai2 + ai3 + «2i + ^23 — d ai2 + ai3 + a2i + a23 + d 



d = y (ai2 + ai3 - "21 - a23)^ + 4ai2a2i • 

There are two time-scales in W (t) which are very different, in many cases: the 
short time (tg) corresponds typically (though not always) to an establishment of a quasi- 
stationary distribution between states 1 and 2 while the long time (ti) corresponds typi- 
cally to an escape from the system of states 1 and 2 on the whole. 

Knowing W , one can obtain all physical quantities which could be of interest in the 
first-passage problem. 

First of all, it is a flux of first passages, J^^^ 0: 



j(^) = aisW^^^ + a23W^^^ = ai3e + (aigOi + a23«2)(e - e *»)• (2-^ 



The term ai3exp(— ^) dominates at the initial stage while only the term oc exp(— ^) 
remains in the long-time scale. 

It is worth to point out that, at the condition 



^1^ <1, (2.9) 

ai3ttl + 0!230i2 

the flux is a non-monotonic function of time: it increases from 013 at t = to 



Jm = («13ai + «23«2)[f /3]^(1 - (1 - /9)[^(1 - /?)] ^) (2.10) 

at 

■^It will be meant by flux everywhere further in the text just J^^\ unless it is specified otherwise. Note 
that, for any system, J^^^ and a conventional flux coincide at an initial instant while, in the Kramers 
problem i.e. for an escape from a metastable potential, they coincide at any time. 
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t^t^=^^yj{i-p)] (2.11) 



and then decreases to zero as t becomes much larger ti. 
If 

ts^tu (2.12) 

which is true in a majority of cases (a quasi-stationary distribution is being estabhshed 
much quicker than a transition to a final state occurs), then (2.10), (2.11) are simphfied: 

= aigai + a23a2, = ln[^(l - /?)], (2.13) 

ts < tl. 

In the context of prehistory experiments |0 and optimal control of fluctuational 



transitions |Q, |2^|, it is important to know from which of attractors most probable 
the system arrives at a final attractor for the first time. The ratio of the corresponding 
integral probabilities 



^ _ /o°° dta^M"^ ^ anjaiti + (1 - ai%) 



[2.U) 



tti3(a2i + "23) V («i2 + «i3 - "21 - (^23)'^ + 4ai2a2i 

023012(012 + "13 + Q!21 + 023) 

One more important characteristic of the transition is a mean first passage 



MFPT = r dtt{ai3Wi^^ + 0231^2'^) = ai3(ait' + (1 - ai)t') + a23«2(t' - tl) 
Jo 

(2.15) 

ai2 + 0:21 + a23 



a2iai3 + ai2a23 + ai3a23 



*The formula (2.15) can be also considered as a partial case of a more general formula given in pl| 
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2. 2. LIMIT CASES 



It is useful to analyze three quite typical limit cases 



1. 



q;i3 <^ ai2, a.2z <^ a.21. (2-16) 

As a simple illustration, one can bear in mind a potential system shown in Fig. 2 (c.f. 
also Fig.4). 

In the case when (2.16) is satisfied, 

Oi2l «12 _^ I ^ ai2 + ^21 /n-.r,N 

CKi , a2 ~ , ts ~ , tl ^ . (2.17) 

"12 + «21 Ctl2 + Q!21 Ctl2 + Q!21 Ci;21«13 + «12«23 

Correspondingly, 

J ft! Ctiae Hai2+a2lJ _^ aja+aji _g H«i2+a:2i;j^ (2.18) 

Q;12 + C(21 

The condition (2.12) is obviously satisfied if (2.16) holds true. Correspondingly, if the 
inequality (2.9), which is very simplified in this limit, 

Oin < 0(23, (2-19) 
is satisfied then J^^\t) is non-monotonic: it has a maximum at 



1 ni:j(r\i2 + 021)''^ 



Oi\2 + OL2\ {pL2\ax3 + ax20L23)^ ' 
OI.2\OLvi + OLV2OL23 



(2.20) 



Q;12 + OL2\ 

The condition (2.19), providing an increase of J^^^(i) at an initial stage, is quite clear: if 
Q!23 > CKis then the fiux should increase as the population of the state 2 grows. 

The expression for i?, indicating a state from which most probable the system arrives 
at a final point, also becomes in the limit (2.16) very simple: 

12 



R^^^. (2.21) 

Q;i2a23 

It is just an established at i ~ is ratio of populations in 1 and 2 multiplied by the ratio 
of the corresponding rates of transitions to 3. 
At last, 



MFPT = ^ ^ ti. (2.22) 

a2iai3 + ai2a23 



2. 



q;i3 <^ ai2, Oi2i <^ q;23 <^ ai2. (2.23) 

An illustration of this limit could be a potential system shown in the Fig. 3 (a). 
In the case when (2.23) is satisfied, 

Ct21 1 1 

ai , a2 f« 1, is ~ , k ~ ■ (2.24) 

ai2 ai2 a23 

Correspondingly, 

^ aiae-"!^* + a23{e-"^'^ - 6""^^*). (2.25) 

The condition for a non-monotonicity J*^^^ coincides with (2.19). 
The expression for R and MFPT are respectively 



i??5i^<l, MFPT ^ a^^ p^ti. (2.26) 

q;i2 



3. 



a2i < q;23 < Q;i2 < ctia. (2.27) 

For an example, see Fig.3(b). 
In this case. 
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q;i2Q;2i ai2 1 1 , . 

ai fti — - — , a2 ^ , ts ^ , tl fti . (2.28) 

afs Q;i3 ai3 ^23 

Correspondingly, 

J(^) ^ aige"""* + ^^i^ (e-"23* - e'^^^*) . (2.29) 

The flux (2.29) monotonicaUy decreases: flrst, for a short time ~ tg, from a large value 
q;i3 to a small value a;i2Q;23/cn3, and then, for a long time ~ ti, to zero. There is, however, 
such paradox. From one side, the system transits to 3 most probable, obviously, via the 
"direct" route (which is characterized by the short time scale tg): 



i?Ri^>l, (2.30) 

"12 

SO that one could expect that MFPT is equal to tg- However it is not so: 

MFPT « > J_. (2.31) 

«13«23 «13 

The physical reason is that, although the probability for a system to come to 2 before 
to get into 3 is small (namely a.i2/oiiz)-i the time which it spends in 2 is very large 
(~ 0.2^) , so that the contribution into the MFPT is larger than that one from realizations 
corresponding to the direct transition, notwithstanding an overwhelming probability of 
the latter. Note also that MFPT is not equal to ti either. 
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Chapter 3 



Transition rates. Potential systems 



As it follows from Sec. 2, a transition problem in a multi-stable system driven by weak noise 
can be described in terms of direct transition rates and, therefore, the most fundamental 
task for a theory in the context of a transition problem is to calculate transition rates. We 
shall consider in this Section such rates in potential systems. But, first, let us review briefly 
the concept of large fluctuation in general. With this aim, we write in a path-integral 
representation [|l^] a transition probability density in a space of dynamical variables: 



aUxi,tf,Xi,t;)= Df{t)F[f{t)]6ixitf)~Xi) (3.1) 

where Xf and Xj are respectively final (at t = tf) and initial (at t = ti) values of dynamical 
variables (many-dimensional, generally speaking) while P[/()f:)] is a functional character- 
izing a probability density of a given noise realization / (t) . The dependence of P on noise 
intensity -Dnoise is usually of the activation- like type |T3[ : 



nfit)] = |e-i, (3.2) 



where Z is a normalization factor. 



In particular, for a white noise |T3[ , 



S[f] = l fdrfir). (3.3) 
/ Jo 

Transforming from noise variables to dynamical variables (using Langevin equations: 
c.f. for example eq.(3.6)), we derive 
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l'x(tf)=Xf I S[x] 

atr = / Dx{t)J{x)-e ^-i^e, (3.4) 

Jx{ti)=Xi Zj 

where J is a Jacobian of the transformation {/ — ^ x} while ^[^(t)] = ^[/(t)]. 

If we consider only a direct transition i.e. a transition which does not follow an 
intermediate attractorQ then it follows from (3.4) that 

^(direct) 

(direct) Eiin 

"tr = «pree , (3.5) 

where >S'^^'^'^*'' = 5'[xopt(t)] is a minimum of the functional S\x\ among all trajectories 

providing a direct transition while preexponential factor which depends on noise 

intensity relatively weakly. 

A direct transition rate (1.3) and a direct transition probability density (3.5) are closely 

related so that activation-like factors in them obviously coincide. It is usually most 

important for a theory of a direct transition rate to determine just the most strong, 

exponential, factor^in atr i.e. to find 5*^*^^'^*''. The problem for a minimum of a functional 

is a well defined mathematical problem. However it is very difficult (in a majority cases 

impossible) to obtain its solution in an explicit form while a purely numerical solution 

does not allow to come to general conclusions on characteristic features of solutions and, 

besides, it consumes a lot of computer time. That is why each explicit solution is very 

valuable especially if it reveals non-trivial features. An important class of systems for 

which an explicit (or at least partly explicit) solution of the transition problem is possible 

are potential systems subject to linear friction and white noise: 

^If a path which provides a minimum of S\x(t')\ does follow an intermediate attractor then, unlike ttpre 

in (3.5), a "preexponential" factor depends on -Dnoiso also activation-like because a system stays in an 

intermediate attractor during a period whose characteristic duration depends on -Dnoisc activation- like 

so that a portion of trajectories contributing into atr also depends on I?noiso activation- like. At the same 

time, as it has been mentioned in Sees. 1,2, a transition which follows an intermediate attractor should 

be described as a succession of transitions like in a corresponding Markov chain so that such paths 

are not relevant to direct transition rates. 

^The problem of a pre- factor is usually yet more complicated than the problem of an exponential 

factor. However, allowing for a comparatively weak dependence on noise intensity, a pre-factor may be 

put a phenomenological constant in a wide range of transition rates. 
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q + Tq + dU/dq = f{t), (3.6) 
(fit)) = 0, (fit) fit')) = Dnoisc5(t - t'), A.oisc = 2rT, 

where T has a meaning of temperature. 

Apart from that such model has numerous apphcations in physics, chemistry, engineer- 
ing, etc. (see e.g. 1^, 0, [^) it is distinguished from others by the property of detailed 



balance Some general consequences of the detailed balance in potential (generally, 
multi-well) systems are analysed below in Sec. 3.1. A reduction of a general variational 
problem for a minimal action to some much more simple problem is presented in Sec. 3. 2 
while a major part of the paper is concentrated in Sec. 3. 3 which is devoted to an appli- 
cation of general results to transitions from a stationary attractor and particularly to a 
generalized Kramers problem. 

3.1. DETAILED BALANCE 

Basing on the property of the detailed balance, let us show that transition rates 
between states which are not connected by a relaxational trajectory contain a small mul- 
tiplier, in addition to the conventional factor exp{—AE/T) where AE is a difference 
between final and initial energies, if the former is larger than the latter, or zero otherwise. 

The property of the detailed balance reads for the system (3.6) 



W3t(l)atr(l ^ 2) = W,t{2)atr{2* ^ 1*) (3.7) 
where Wst is a stationary probability density, which is Gibbsian 



iy,tOcexp(-|), , E = qy2 + U{q), (3.8) 

atr{i — >■ j) is a rate for a transition from a state z to a state j, and the star * means that 
a conjugate state i* has the same coordinate as i but an opposite velocity. 

In the case when there is a relaxational trajectory from 2* to 1*, atr(2* — > 1*) is of 
the order of 1, up to a logarithmic accuracy, because the noise is not necessary for such 
transition and the action (3.3) is equal to zero. Then it follows from (3.7), (3.8) that 
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E(2)-E(l) „„] 

atr(l ^ 2) -e^^V^, 2*^r. (3.9) 

It can be shown that a conventional trajectory time-reverse to a relaxational trajectory 
provides the equahty of the action functional S'/(2r) just to the difference of energies, 
thus indicating that it is just the most probable direct transition path (c.f. e.g. ||26|| ) . 

The eq. (3.9) is relevant e.g. to a conventional (single-well) Kramers problem: states 1 
and 2 correspond then to the bottom of the well and to the top of the barrier respectively. 

If, on the contrary, 2* and 1* are not connected by a relaxational trajectory then 
atr(2* — > 1*) is exponentially small (if temperature is small enough) because some finite 
noise is necessary in order to get from 2* to 1* and hence the action (3.3) is non-zero: 



atr(2* r) ~e- — , T<A5, (3.10) 

rel 

2* 74 1*. 

Then it follows from (3.7), (3.8), (3.10) that 



-B(2)--B(1)+AS 

atr(1^2)~e T , T<A5, (3.11) 

2* 74 1*. 

Even if we do not know a concrete value AS*, we can carry out a qualitative (and, 
partly, even quantitative) analysis based on eqs. (3.10), (3.11) and results of Sec. 2. 

Let us consider as an example the problem of a first passage from 1 to 3 in a potential 
shown in Fig.2. Within a logarithmic accuracy, it is equivalent to the problem of a first 
passage from 1 to 5*2. 

For the case shown on Fig.2(a), a noise-free trajectory from S2 goes into 2. Hence, 

«23 ~ e T ^ ai3 ~ e t . (3.12) 



Allowing also for 



~ e T ^ ~ e t (3.13) 
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and for the hierarchy of energies 



C/2 < [/i < Us, < Us,, (3.14) 

this case corresponds to the hmit case (1) considered in Sec.2 and eqs. (2.16)- (2.22) hold 
true. In particular, 



i?=^^~e-— <1, MFPT = ~e (3.15) 

Q;i2a23 ai2Q;23 + ct2icti3 

^2 ^ 2. 

Similarly, for the case shown on Fig.2(b) which differs from that one on Fig. 2(a) only 
by friction so that the relaxational trajectory from 5*2 goes into the well 1, 



i?~e^»l, MFPT^e-'-^^, (3.16) 
^2^1. 

Thus, the system chooses in any case the "easiest" way - the "direct" route if the 
relaxational trajectory 5*2 ^ 1 exists or the "successive" route if it does not - so that, 
within a logarithmic accuracy, MFPT does not depend on friction and the "activation 
energy" in the expression for MFPT is equal in both cases to the energy difference 
between a top of the highest barrier and a bottom of the deepest (among 1 and 2) well. 

The cases shown on Fig. 3, (a) and (b), correspond respectively to the limit cases (2) 
and (3) in Sec.2. The analysis similar to that one for Fig. 2 shows that, unhke the case 
(a), MFPT in the case (b) essentially depends on AS: 



(7s -t/2-AS 

MFPT^e T , AS<Us2-U2, (3.17) 

5i ^3. 

And obviously, in all cases, AS determines a flux at an "initial" (but still exponentially 
long) stage. For many other problems e.g. an optimal control of fluctuations and a directed 
diffusion in periodically driven ratchets (see Sec. 4), one needs to know, apart from action, 
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the most probable direct transition path MPDTP. The rest of Sec. 3 is devoted to a 
derivation of the MPDTP and calculation action along it. 



3.2. GENERAL SOLUTION OF THE VARIATIONAL PROBLEM 

In order to find S^^l^^^'' for a direct transition between some given states, i ^ j, one 
needs to express f{t) via dynamical variables from (3.6), to substitute it into the action 
functional S[f] (3.3) and then to find such trajectory q{t) which provides a minimum of 
S[q] = 5'[/]/(2r) among all direct trajectories: 

5„in = min(5), S= dtL{q,q,q), L = ^{q + Vq + dU / dq)\ (3.18) 
where it is assumed that q{t) does not follow intermediate attractors while 

aS) = ^, J, (3.19) 

and a duration of the transition ttr should be varied too, in order to minimize 5*. 

The necessary condition for the extremum of a functional is an equality of its variation 
to zero. In the case of the functional (3.18), it is reduced to the Euler-Poisson equation 



37| , for q{t) possessing finite derivatives up to the 4th order: 



dL d ,dL. d^ ,dL. 

with the boundary conditions (3.19). 

In order to minimize S over ttr one needs to equal the derivative to zero: 

Substituting S (3.18) into (3.21), carrying out an integration by parts twice and using 
(3.20), one can derive the equivalent condition l^Tj : 



~ ~ ,dL d ,dL^^ dL 

E = 0. iJ. -L + (_-_(_)), + (3.22) 



Here, E is analogous to mechanical energy |^ and is conserved at a solution of (3.20). 
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Let us seek the solution qopt{t) of the Euler-Poisson equation (3.20) with boundary 
conditions (3.19) as a function time-reverse to a solution of such equation 



q + r'{t)q + dU/dq = 0, (3.23) 

(<liO)\ _ ■* (<jittr)\ _ ■* 

1<?(0)J -3 ' yqihr)) - * ' 

Qopt{t) = q{ttr -t), 

where r'{t) is so far unknown, a constant ttr is so far arbitrary and will be determined 
later from the condition (3.22), and a star * has the same meaning as in (3.7). 

Note that there is no danger to miss a true solution of the variational problem when 
we use the representation (3.23). Indeed, assume that we know a true solution qtrue{t) 
(with a transition time Urue)- Then, a function q{t) — qtrueiUrue — t) satisfies (3.23) if 

■• (j. -L. '^^ {itrue {Urue —t)) 

, qtruey^true rin^ (t^ _+l 

r'(t) = -— ^_^«-(^*-- *) , ttr = ttrue, (3.24) 

qtrue\Hrue 

SO that qopt{t) — ?tr«e(0 Qtrue{t) IS ncccssarily among solutions of the type (3.23). 

Of course, one could seek a solution of the Euler-Poisson equation using a different 
representation but it is just the representation (3.23) which allows to reduce the com- 
plicated 4th-order differential equation (3.20) to a much more simple equation. Indeed, 
putting qopt{t) (3.23) into the Euler-Poisson equation (3.20) with the Lagrange function 
L (3.18) one can derive, after some transformations (see the Appendix B), 

dh ld4>dq ^-fftll! dT' (ooK^ 

where q = q{t) is determined by (3.23). The equation (3.25) has solutions of three types: 



(1) = 0, 

(2) 1 = 0, (3.26) 

(3) nf^r -c, c^o. 

The second type, obviously, docs not suit us because it cannot satisfy the conditions 
(3.19). The third type is not suitable either: it does not satisfy the condition for a 
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minimization over a transition time (3.22). Indeed, if one substitutes into E (3.22) the 
Lagrange function L (3.18) with qoptif) (3.23) in which T'{t) satisfies the equation (3) in 
(3.26), one obtains (c.f. the derivation eq.(3.25) in Appendix B) 

E = -^- (3.27) 

Thus, in order to satisfy both the Euler-Poisson equation (3.20) (together with the 
boundary conditions (3.19)) and the condition of zero quasi-energy E (3.22), one needs 
to choose in (3.26) the equation of the type (1). This equation can be solved exphcitly: 

1 _|_ Ap^t 

= (3.28) 

where a constant of integration A should be chosen so that the proper relaxation j* i* 
(3.23) takes place 0. 

If A < then the function T'{t) (3.28) has a zero (in which V changes its sign) at 

^ = ^o = ^ln(^) (3.29) 

If A > then the function T'{t) (3.28) has a singularity (a pole of the first order) at 
After the initial version of this paper had been prepared my attention was drawn to papers |^^, in 
which equations equivalent to (3.23), (3.28) were obtained from the Hamilton equations corresponding to 
the Lagrangian L (3.18), in a problem of a nonequilibrium potential which determined a quasi-stationary 
distribution (note that, in these papers, the auxiliary friction is written for a direct rather than time- 
reverse path so that their A corresponds to my ~Aex-p{rttr))- Apart from I obtain (3.23), (3.28) by a 
different method and in a different context, I advance in many important respects much more far than 
authors of 1) I prove that the type of a solution (3.23), (3.28) is the only type which can provide 

an extremum of action, as well as I prove that the MPDTP cannot be sewed from trajectories of the 
type (3.23), (3.28) with different A unless they are sewed in sadles (see Appendix C and the rest of the 
sub-section), 2) I provide a detailed analysis of an influence of the singularity in (3.28) at the MPDTP 
(see Appendix D), 3) unlike my analysis provides also a description of the MPDTP with a 

given (rather than just optimal) duration of the transition (see eqs. (3.26.3), (3.27) and the item 3 in 
Sec. 4) , 4) I apply the general solution to the generalized Kramers problem and provide a detailed rigorous 
analysis for the corresponding MPDTP and action (see Sec. 3.3), 5) I derive explicit expressions for 
action and the MPDTP in overdamped and underdamped regimes (see Sec. 3.3.2 and 3.3.3 respectively), 
6) I suggest various other applications of the general results (see Sec. 4). 
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t = tp^^Hj). (3.30) 

Due to this, a velocity of the auxihary system (3.23), q, drops to zero at t = tp while T' 
changes its sign. 

At any sign of A, T' turns into — F as t grows to infinity. 



r'(+oo) = -r. (3.31) 

The next important question is whether an extremal can be "sewed" from trajectories 
of the type (3.23), (3.28) with different A. Such sewing could seem natural since the 
Euler-Poisson equation would be satisfied everywhere except possibly the very sewing 
point. However it is proved in Appendix C that such sewing necessarily breaks the 
equality of the variation of the functional S (3.18) to zero (which is just a definition of an 
extremal) unless the sewing point is either a stationary point of the potential system. 



dU/dq = 0, q = (3.32) 

or a turning point (g = 0) whose coordinate is a coordinate of a discontinuity dU / dq. 

Taken that we are interested only by direct transitions, extremals which include at- 
tractors as sewing points are not relevant. For the sake of brevity, let us call the remaining 
extremals i.e. extremals which do not follow intermediate attractors as direct extremals. A 
next step is to find that direct extremal (if it is) along which action is smaller than along 
any other direct extremal i.e. to find the most probable direct transition path (MPDTP) 
if it is. The further analysis differs essentially for cases when 1) neither an initial nor final 
state of transition is a non-stationary (periodic) attractor while at least one of them is a 
stationary point, 2) one of the states is a periodic attractor, 3) neither of the states is nei- 
ther a periodic attractor nor a stationary point. The case 3) is more of a formal rather than 
practical interest and will be discussed briefly in the end of this sub-section. As concerns 
a periodic attractor which may exist in a tilted periodic potential ||3^, a nonequilibrium 
potential (which is closely related to action) in the presence of such attractor was briefly 
analysed in [^. However the analysis of ||2^ concentrated on a quasi- stationary distri- 
bution rather than on the transition problem and even that analysis was far from being 
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complete. Some partial case was analysed numerically and by Monte-Carlo simulations 
in . A consistent rigorous analysis of the associated variational problem is planned to 
be done by me elsewhere. 

In the present paper, I shall consider mostly the case when i is a stationary attractor 
while j is a saddle: just this case is relevant to an escape from a multi-well metastable 
potential i.e. to the generalized Kramers problem (c.f. Figs.l, 4), which is the main 
subject of the present paper, as well as to inter-attractor transitions in a stable multi-well 
potential (it does not matter for an exponential factor whether a final point is an attractor 
or a saddle from which a system may relax to the final attractor noise-free). 

3.3. GENERALIZED KRAMERS PROBLEM 

For the sake of clarity and brevity, I restrict the analysis to the case when only two 
smooth adjacent potential wells are involved (see Fig.4(a) as an illustration), namely let 
the following conditions are satisfied: 

1) a potential function U{q) possesses at least two adjacent parabolic local minima 1 
and 2 and, apart from a local maximum 5*1 between 1 and 2, there is at least one 
more adjacent to it local maximum S2', 

2) in the energy-coordinate plane E — q, noise-free trajectories emanating from Si go 
either into 1 or into 2 and do not pass above any local maximum of the curve 
E = U{q); 

3) (a) if > then the bit 5*20, where O is the nearest to 5*2 in the direction 
q{S2) •— > q{Si) intersection of the horisontal line E = Us.2 with the curve E = U{q), 
lies above only one local maximum of the curve E = U{q), namely Si; 

(b) if < Usi then the bit SiO, where O is the nearest to 5*1 in the direction 
^(5*2) (l{Si) intersection of the horisontal line E = Us-^ with the curve E = U{q), 
does not lie above any local maximum; 

4) the initial state of the transition is 1 while the final one is 5*2. 
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It should be emphasized that Fig. 4(a) is just an illustrating example while the consid- 
eration below is valid also in the case when 5*2 is adjacent to 1 rather than to 2 as well as 
when < Us^ (but the condition 2 above is still valid). 

A generalization for a larger number of involved attractors is straightforward. In par- 
ticular, a case of inter-attractor transitions in a 3- well potential (see Sec. 4) is immediately 
reduced to the case considered in the present sub-section. 

3.3.1. Most probable direct transition path 

First of all let us prove that if 5*2 belongs to a basin of attraction of 1 then a conven- 
tional time-reverse relaxational trajectory does provide an absolute minimum of action. 
Substituting qoptif) (3.23) into the action functional (3.18), we obtain 

= Us,-U^ + ^ 1^*" dtiV - r(t))2g2^,(t,, - t), (3.33) 
where, at the derivation of the second equality, it has been allowed for 

r(t)&,(t..-t) = - ^^^^°^j^*--^^\ (3.34) 

where E = + U{q) is an energy along the auxiliary relaxational trajectory (3.23). 

If we put A = into F' (3.28) we provide both a relaxation from S2 just to 1 0, 
5*2 1, and an equality F' to F which obviously provides the minimal possible action 
equal just to a difference of energies. 

Now, we pass to the most interesting case when a final state S2 does not belong 
to a basin of attraction of an initial attractor 1. Let us show first that the MP DTP 
1 — s> 5*2 goes necessarily through the saddle^ Si. Let us assume that a path which is time- 
reverse to the MP DTP includes some point B of the boundary of basin of attraction of 

"^Note that q — Q both in 6*2 and in 1 so that they coincide with ^2 and 1* respectively. 

^For the sake of brevity, we use here and thereafter a term saddle in relation to 5*1 (and analogously, 

to ^2) both in a case of a smooth maximum when it is a true saddle and in a more formal case of a 

cusp-like maximum when Si is even not a stationary point (though, like a true saddle, it possesses two 

incoming and two outcoming manifolds). 
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1 which differs from 5*1. Then, taken into account that this point belongs to the basin of 
attraction of 1 and, therefore, the trajectory time-reverse to the MPDTP 1 ^ B* is just 
a relaxational trajectory B ^ 1 which, in this case, necessarily follows the saddle 5*1, we 
come to the conclusion that the saddle 5*1 is definitely followed by the MPDTP 1 — ^ 5*20 
(c.f. also [0). 

Thus, if 5*2 does not belong to a basin of attraction of 1 the MPDTP from 1 to 5*2 
consists of two bits: 

1) from 1 to 5*1, following the conventional time-reverse relaxational path 1 Si ; 

2) from Si to 52- 

Taken that, for a smooth potential U{q), direct extremals may be sewed only in saddles 
while there are no saddles other than Si and 5*2 in our problem, the MPDTP Si S2 
is definitely a path with a single A, Si ^ S2. The question about a proper choice of A is 
one of central questions of the present paper. We need to choose from all direct extremals 
Si —>■ S2 (they have been described in Sec. 3. 2 in a general form and their number may 
be infinite) that one which provides a minimum for action. An algorithm for the choice 
depends on a satisfaction such 2 conditions []: 

Condition 1. A noise-free trajectory S2 2 possesses points both with q < q{Si) and with q > 
q{Si) (it is equivalent to that the trajectory passes in the energy-coordinate plane 
above the saddle Si at least once: c.f. the thin dashed line in Fig.4(a)). 

Condition 2. A noise-free trajectory S2 ^ 2 and a trajectory 2 Si (which is time-reverse 
to Si —^2) intersect at least once, apart from the obvious common point 2 (c.f. 
intersections of the thin dashed and solid lines in Fig. 4(a); note that, in the energy- 
coordinate plane, any trajectory overlaps a time-reverse to it trajectory, so that 
2 Si and Si^ 2 are presented in Fig. 4(a) by one and the same line). 

Correspondingly, any case is described by one of 4 theorems presented below. For 

their formulation, it is convenient to introduce the following definitions. 

^In fact, as it follows from the consideration below, is the only point of the boundary of the basin 

of attraction of 1 which belongs to the time-reverse to the MPDTP trajectory. 

^As r varies, a satisfaction of these conditions changes at some critical values which will be discussed 

in the next sub-section. 
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Definition 1. Let us define a bit of a trajectory as a passage if a velocity is equal to zero 
in the beginning and in the end of the bit while it does not change its sign in between 
them (e.g. the trajectory shown in Fig.4 by the dotted hne consists of 2 passages). 

Definition 2. Let us define a point / as the highest in energy intersection of the trajec- 
tories ^2 ^ 2 and 2 (c.f. Fig.4(a)). 

Definition 3. Let us define A_ as such negative value that the number of passages in 

A- 

Si — > 5'2, n_, is equal to a number of passages in the bit of the noise-free trajectory 

a rel J 

Definition 4. Let us define as such positive value that the number of passages in 
(S*! ^ 5'2, n+, is smaller than rirei by one: n+ = rirei — 1- 

Theorem 1. Let both conditions 1 and 2 he satisfied. Then, the MP DTP Si — > 5*2 is 

A— Am 

either Si S2 or Si S2 while action along the MPDTP is less than — ^2- 
Remark 1. Theorem 1 is relevant typically to small V: an example is shown in Fig.4 

A— A+ 

{Si — > S2 and Si — > 5*2 are shown by the thick dashed and dotted hues respectively). 
Intuitively, the specified in the theorem choice of extremals is rather clear: as it follows 
from (3.33), T'{t) should differ from V as little as possible - and the above described paths 
provide such V which, on a major part of a path, is only slightly either smaller (for A_) or 
larger (for >1+) than P. But the rigorous proof is quite tricky and uses mainly geometrical 
arguments. 

Proof. 

Let us first prove that a minimal action is smaller than — ^^2- The conventional 
successive path Si^ 2 S2 provides action equal just to Us^ — C^2- Let us construct 
the path Si ^ P — > S2. It is a part of -Si — > 2 — > ^'2 and, obviously, action along 
the latter path exceeds action along the former one. Thus, a minimal action should be 
definitely less than — U2. 

As concerns the MPDTP, let us consider separately negative and positive A. 

(a) A < 0. 

First of all, let us prove an existence of the described above 
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Consider first a case when the noise-free trajectory 5*2 —> 2 possesses at least one 
turning point^ between 5*1 and 2. If we decrease A continuously from zero a dissipation of 
energy along the relaxational trajectory 5*2 decreases continuously so that the highest 
in energy turning point continuously moves up in energy and necessarily reaches 5*1 at 
some finite 1^41, when the whole path lies above the trajectory Si ^ 2 (except the very 
5*1, obviously). And just this A is A_ as it follows from the definition A_. 

In that case when the trajectory 5*2 ^ 2 does not possess any turning point between 
Si and 2, the trajectory Si ^ 2 necessarily possesses at least one turning point to the 

right from 2 (otherwise the condition 2 would not hold true). Then if we decrease A 

ji 

continuously from zero a gain of energy along the path 5*1 — > increases continuously so 
that the highest in energy turning point continuously moves up in energy until it meets 
5*2 which will correspond just to A = A_, by the definition A^ {n_ = 1 in this case). 

Note that if the condition 2 did not hold true the above proof of an existence A_ 
would not be valid (see the theorems 3, 4 below). 

Let us show that if Si is a smooth maximum then there are no A < A_ at which 
Si S2 could exist. Indeed, in this case, Si is an unstable stationary point and the 

relA— 

approach of the relaxational trajectory ^2 —>■ Si towards the saddle Si occurs infinitely 

slowly: energy first decreases to a certain minimal value Emin{A-) (which is slightly less 

than f/^J at an instant to (3.29) and then starts to increase to f/g^. If 1^41 > \A_\ then 

the change of the sign T occurs too early and energy along the trajectory 5*2 starts to 

increase before it reaches the level Ejnin{A^) so that the trajectory passes above Si. 

In the case when Si is a cusp-like maximum, paths S2 with A < A_ may exist. 

Let us prove that neither of them can be the MPDTP. Indeed, such path contains 

less number of passages than n_ which means that the time-reverse to it path inevitably 

intersects the boundary of basin of attraction of 1 in some point Pi which is not 5*1 (c.f. 

the Fig.4(b)). But the MPDTP 1 P* is time-reverse to Pi ^ 1 while the latter 

just follows the boundary of attraction 1 (until it meets the saddle 5*1) rather than just 

intersects the boundary. This proves that 1 Si ^~ S2 cannot be the MPDTP 
^We use a term turning point in a conventional for a physical literature meaning of a point on a 
trajectory where a velocity changes its sign. 
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Let us prove that a path S2 cannot provide the MPDTP if \A\ < \A^\. 

Indeed, if we decrease \A\ continuosly then r'{t) increases for all t i.e. a dissipation of 
energy along the relaxation trajectory S2 increases too and, hence, the trajectory 
lowers and necessarily intersects in some point P the trajectory 2 Si. Let A is such 
that, after one or more oscillations in the well 2, the trajectory does come into Si. Let us 
construct the path Si ^ P* ^ S2. Action along the bit Si ^ P* is equal to zero while 
P* S2 is only a part of ^ 5*2 and action along the completing part. Si P*, is 
definitely non-zero. Thus, action along Si S2 is certainly not minimal. 

Thus, among all negative A, only A_ may provide a minimum of action. 

(b) A > 0. 

First of all, let us show that Aj^ exists. Due to the condition i, iS'2 — > 2 docs pass 
in the energy-coordinate plane above Si. If to increase A continuously from zero then a 
dissipation of energy along the trajectory S2 increases and the trajectory lowers so 
that it necessarily meets Si at some A which is just by the definition A+. 

If ^4 < Aj^ then the relaxation trajectory first goes into the well 2 and, at the corre- 
sponding instant tp (3.30), the velocity q drops to zero while energy drops to some value 
Emin{A) = U{q{tp)) < Usj^. As it is shown in Appendix D, the system goes then "back 
in time" along the same trajectory by which it arrived at g = Qitp) unless dU/dq — 
at g = q{tp). In the former case, it cannot arrive at Si while, in the latter case i.e. if 
Qi'tp) — ?(2), it is not a direct extremal (moreover, action along a path following the 
attractor 2 is > Us.2 ~ U2). 

If ^4 > Aj^ the number of passages decreases which means that S2 Si inevitably 
intersects the boundary of basin of attraction of 1 in some point P2 which is not Si (c.f. 
the Fig.4(b)) while a trajectory time-reverse to the MPDTP 1 — > P2 should follow the 
boundary (until it meets Si) rather than just intersect the boundary. 

Thus, among all positive A, only A^ may provide a minimum of action. 

Thus, the theorem 1 has been proved. 

Remark 2. It is interesting to notice that if U (q) is smooth in Si (which is a typical case) 

vclA-L. 

then the relaxational trajectory 5*2 approaches Si at a finite instant of time (note the 
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footnote 7 above), unlike the trajectory 5*2 the former trajectory reaches the saddle 

just at the instant t^"^^ = tp(y4+) (3.30). Indeed, if the transition instant ttr was smaller 
than then T'(t) would be positive and finite at any t <ttr - but, at any finite positive 
friction, the approach to the saddle should take an infinite period which contradicts to 
the original assumption that ttr < On the other hand, if ttr was larger than t^+) then 
we would also come to a controversy. Indeed, at the instant t = t!^\ the velocity q must 
drop to zero. It is shown in the Appendix D that, unless the coordinate q{t!^^) coincides 
with a coordinate of the saddle 5*1 or of the bottom of the well 2, the trajectory returns 
along the same trajectory to 5*2 and therefore cannot provide the transition 5*2 —>■ Si. 
But, due to the assumption that ttr > the saddle 5*1 cannot be reached at the instant 
t^\ The bottom of the well 2 is not suitable either since a path following 2 cannot be the 
MPDTP, by the definition of the MPDTP. Thus, we have again come to a controvercy 
with the original assumption and, hence, the transition time is just t^\ 

Remark 3. Let us describe briefly how to find constants A+. In an underdamped 
limit (r is small in comparison with characteristic eigenfrequencies) , they can be found 
explicitly which will be done in Sec. 3. 3. 3. In a general case, they have to be found 
numerically by a trial-and-error method in which a constant A is being fitted until a 
relaxation trajectory (3.23), (3.28) 5*2 arrives at 5*1 while the resulting trajectory 
5*2 Si consists from rirei or rirei — 1 passages, for and A^ respectively (note the 
footnote 7). This procedure is incomparably easier than a direct numerical solution of 
the variational problem (c.f. ^1|]) and takes very little of computer time. A concrete 



algorithm may vary. E.g. one may use a standard method of successive approximation 
starting from the ranges [—1,0] and [0, 1], for A_ and A^ respectively. A convergence is 
typically quick. 

Theorem 2. Let the condition 2 be satisfied while the condition 1 he not. Then the 
MPDTP Si S2 is the path Si S2 while action along it is < — 
Proof. 

The proof is nearly identical to that one in the theorem 1. The only difference is that 
there are no direct paths corresponding to positive A. 



30 



Before to pass to two other theorems (whose proof is probably the most non-trivial 
part of the paper) let us present qualitative arguments in favor of that an extremal with 
a single negative A does not exist at large enough friction: such arguments will facilitate 
an understanding the rigorous proof of theorems 3, 4. For the sake of simplicity, let 
us consider the most typical case, when U{q) is smooth both in 5*1 and 5*2. For the 
overdamped case, a noise-free trajectory emanating from Si or 5*2 follows nearly the very 
slope (left or right, respectively) of the potential well 2. A friction r'{t) (3.28) varies along 
the trajectory S2 from F at i = —00 to — F at t = 00. A transition between these two 
regimes occurs for an interval ~ F^^ and, hence, in order for the trajectory to manage to 
come to rather than to pass above it it should manage for this interval ~ F~^ to pass 
from the right slope to the left one. However such passage (a large part of which takes 
place in the regime F' <^ F) would require an interval ~ o;"^ where ujosc is a characteristic 
frequency of an eigenoscillation in the well 2. At large enough F, this time is much larger 
than F~^ and therefore the passage between the different slopes does not manage to occur 
which means that an extremal 5*1 S2 cannot exist at large enough F. 

Now, let us formulate the theorem 3 and prove it rigorously. 

Theorem 3. Let neither of the conditions 1 and 2 he satisfied. Then there is no any 
direct extremal which would provide the transition i.e. the MP DTP does not exist. 
Proof. 

An absence of direct extremals with a positive A is obvious: a dissipation along a 
trajectory 5*2 ^^'•-^^ exceeds that one along a noise-free trajectory so that the trajectory 
S2 '^^^-^^ cannot reach 5"!. 

Let us now prove an absence of a path Si S2 with a negative A. If such path with 
some hypothetic negative A = Ah did exist then, for any negative A with \A\ < \Ah\, a 
dissipation of energy along the relaxational trajectory 5*2 should be larger than that 

vclAh 

one along 5*2 ^ , so that the trajectory in energy-coordinate plane would inevitably 
meet the slope of U{q) (i.e. the hue E — U{q)) below Si, in other words, the trajectory 
would have a turning point somewhere between q{Si) and q{2). In particular, this would 
hold true at 1^41 ^ 0. At the same time, if \A\ then a point of minimal energy on 
the trajectory ^2 (corresponding to to (3.29)) approaches the bottom of the well 2 
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because the trajectory 5*2 ^'^''^^ approaches the noise-free trajectory 5*2 ^ at any instant 
t < T-Hn{l/\A\) oo. A potential near 2 may be approximated by a parabola: 

= ,«,(2). (3.35) 

and an analysis of eqs.(3.23), (3.28) is simplified. We are to prove that the trajectory 
5*2 '^^''^'^ cannot possess a turning point between 5*1 and 2 which will be equivalent to the 
proof of a non-existence the path 5*1 ^ 5*2. This task is still non-trivial as it requires an 
explicit solution of eqs.(3.23), (3.28) while, even for such simple potential as (3.35), the 
equations are non-trivial at an arbitrary F. Instead of their solution, one may return to 
the original Euler-Poisson equation (3.20) which is reduced for the case of a parabolic U{q) 
to a linear differential equation of the forth order with constant coefficients and, obviously, 
is easily solved. However, the immediate result of such solution is quite inconvenient for 
the required proof. That is why a different method is used below: I show that the proof 
can be reduced to certain partial case of eqs. (3.23), (3.28) at which the equations have 
a solution in a very convenient for the final proof form. 

A noise-free equation of motion in a parabolic potential is merely a linear differential 



equation with constant coefficients and is easily solved [38|. If F > Fmin, where 



Fmin = 21], (3.36) 

then the solution does not possess turning points in an infinitesimal vicinity of the bottom 
of the well. 

In all cases to which the theorem 3 relates, there is necessarily a small enough (but non- 
zero) vicinity of 2 in which noise-free trajectories do not have any turning point (otherwise 
the condition 2 would hold true which, in its turn, would contradict to the condition of 
the theorem). Hence, relevant values of F are necessarily not less than Fmin (3.36) |^. If 
we prove an absence of turning points between 5*1 and 2 in 5*2 ''^^^^ for F = Fmin it will 
garantee the same for any larger F because the larger F the steeper the trajectory 5*2 

^Typically, a minimal T at which trajectories ^2 ^ 2 and 2 Si do not intersect (apart from 
2) is equal just to Fmin (3.36). However, it may be larger: in those cases when U{q) has steep slopes 
intersections may still occur at large energies notwithstanding their absence in a vicinity of 2, at F > Fnii„. 
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in the energy-coordinate plane and, all the more so, there are no turning points between 
and 2 (a rigorous proof of this will be given further). 

The dynamic equations (3.23), (3.28) for the relaxational trajectory 5*2 in a 

close vicinity of 2, for F = 2Q, can be written as: 



0-2tanh(r)^ + g = O, (3.37) 
q^q-q{2), T^n{t-to), 



where to is given in (3.29). 

The differential equation (3.37) can be solved explicitly: 



q(T) = Cisinh(T) + C2(Tsinh(T) - cosh(T)), (3.38) 

where the integration constants Ci, C2 can be determined from two additional conditions. 

Let a point r = (g^, Qr) on the trajectory S2 ^ 2 which is reached at an instant tr is 
close to 2 enough for a parabolic approximation to be valid and for the trajectory not to 
possess turning points att > tr- If |^| the trajectory 5*2 approaches S2 ^ so that 
a deviation of r from a state on S2 corresponding to the same moment tr becomes 
negligible. Thus, at 

T — Tr = tr — to, (3.39) 

the trajectory (3.38) should pass a state very close to r so that Ci, C2 can be easily found: 



^ _ gj.Tj.cosh(Tr) — qr{rrSmh.{Tr) — cosh(Tr)) ^ —qrCOsh(Tr) + qrSmh.(Tr) 

^ COSh^(Tr) ' ^ COSh^(Tr) 

qr = qr-q{2), = g^- (3.40) 

All close to 2 points of 6*2 ^ 2 (including r) necessarily satisfy certain condition which 
will be particularly important for the further proof. In order to derive it let us write down 
the equation of motion along the noise-free trajectory 5*2 ^ 2 in a vicinity of 2: 

(Pq ^dq ^ ^ 

^ + 2^ + , = 0, (3.41) 
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in which the same notations as in (3.37) are used. Its solution is 



q{r) = [q{Tr) + (r - r,)(^(r,) + q{Tr))]e-^^-^^\ (3.42) 
Differentiating (3.42), we obtain 

t{r) = fe) - (r - TrMTr) + q{Tr))]e~^^-^^\ (3.43) 

from which it follows that in order for a velocity to keep its sign for all finite r > the 
following condition should be satisfied 

44 < ^i^r) + (3.44) 

(the dashed lines in Fig. 5(a) correspond to (i{Tr)/q{Tr) — —1). 

Using (3.44), we show below that a path which possesses a turning point between 
Si and 2 cannot be 5'2 — > . It is convenient to consider separately a case when the 
turning point is approaching 2 as \A\ is approaching zero and a case when the turning 
point remains at a finite distance from q{2) at 1^41 0. 

1). Let a path (3.38) possesses at r = Ti a turning point at < 0. Then (3.38) can be 
written as 

q(r) = ^^^^[(ti - T)sinh(T) + cosh(T)] (3.45) 

COSh(Ti) 

(an example of such path is shown in Fig.5(a)). 
A coordinate-to- velocity ratio along the path is 

R=%^ tanh(T) + (3.46) 
q n-T 

The function R{t) is monotonously increasing at any t ^ t\. 

^ = — r^ + ^^-^>0, r^n. (3.47) 
dr cosh (r) \J\-tY 

Allowing for 



i?(-oo) = -1, 
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(3.48) 



we may conclude that, at any finite r < ti (i.e. along that part of the path which precedes 
the turning point), 



I > -1. (3.49) 

q 

The incompatibility of (3.49) with the condition (3.44) proves that the path (3.45) 
cannot coincide with the path (3.38), (3.40) and therefore S2 cannot possess a 

turning point at an infinitesimal distance to the left from 2. 

2) . Let us show that an assumption that S2 ^^^^^ possesses a turning point between Si 
and 2 at some finite distance from 2 leads to a contradiction too. So, let us assume that 

5*2 '"'^^^^ possesses the above described turning point h at some t = Th- 

'q{Th) = 0, q{Si) - q{2) < q{Th) < 0, q{rh) V 0. (3.50) 

A parabolic approximation may not be valid near h but, near the bottom of the well 
2, the trajectory should still be approximated by the path (3.38), (3.40) which should 
not possess turning points in a vicinity of the bottom of the well and should be sewed 
at large positive r = t; together with the trajectory which is time-reverse to the noise- 
free trajectory emanating from the hypothetic turning point h similar to the sewing 
together with 5*2 ^ at large negative r = Tr- The condition of a sewing with a time- 
reverse trajectory can be immediately obtained on the basis of the condition (3.44) for a 
direct trajectory if to use that fact that a velocity in any point of a time-reverse trajectory 
is just opposite to a velocity in the same point of energy-coordinate plane for a direct 
trajectory. Thus, 

> 1, -q{ri) + 0. (3.51) 

At the same time, it follows from eq.(3.38) 

it: ^ I ^ tanh(r) - (3.52) 
The function R{t) increases monotonously everywhere except 
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7" — Tturn — ^ 1 (3.53) 

which corresponds to a turning point of ?(t). Allowing for the absence of turning points 
in the vicinity of the bottom of the well (which has been proved above in 1)), there should 
be either Ttum > Ti or Ttum < ^r- However, in any of these cases, at least one of the 
conditions (3.44) and (3.51) is not satisfied: in the former case, R{Tr) > —1 while, in the 
latter case, R{ti) < 1 (note that if C2 = then neither (3.44) nor (3.51) are satisfied since 

-1 < R{t) < 1 yt). 

This contradiction proves that the assumption (3.50) is wrong. Together with the 
proof of an impossibility for S2 — ^ to possess a turning point in the very vicinity of 2 
(see 1) above), this proves an absence of a transition path 5*1 5*2 at F = Fmin (3.36). 

Finally, we should prove that, for any larger F, this is all the more so. With this aim, 
let us write down eqs.(3.23), (3.28) for a case A < in the following form 

(Pq ~ dq dU 

Ft 

t = t-to, F(t) = -Ftanh(— ). 

An effective friction r(t) is positive at f < and negative at f > so that the instant 
i = corresponds to a minimal energy on a trajectory, for any F. At the same time, 
the larger F the larger |r(t)| and, therefore, the steeper a trajectory £^(g) in the energy- 
coordinate plane (see Fig. 5(b)). 

If, analogously to the analysis for a case F/ (2Q) = 1, to consider for F/ (2Q) > 1 a case 
\A\ which can be described in a vicinity of 2 in a parabolic approximation (3.35) then 
the corresponding trajectory (3.54) should be sewed at fit = — —00 with a noise-free 
trajectory and at = t/ — > +00 with a trajectory time-reverse to a noise-free one. It is 
easy to derive for a general case F > 2Q the conditions similar to (3.44), (3.51): 

If F > 20 then the corresponding to (3.55) lines in the E — q plane lie necessarily 
lower than those ones for a case F = 20 (c.f. Fig.5(b)). At the same time, as it was 
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shown above, lines corresponding to the trajectory (3.54) for F > he necessarily above 
those for F = 2Q (c.f. Fig.5(b)). Taken that, even at F = 2Q, at least one of the sewing 
conditions (3.55) cannot be satisfied for the path (3.54), it is all the more so at F > 2Q. 
Thus, the theorem 3 has been proved. 

Theorem 4. Let the condition 1 he satisfied while 2 he not. Then the MP DTP Si S2 
is the extremal S2- 

Remark 4- The case described by the theorem 4 is not typical but it may occur if a bottom 
of the well 2 is shallow while a slope of the well 2 between 2 and S2 becomes rather steep 
at some distance from the bottom. 

Proof. 

The proof of a non-existence an extremal with a negative A is identical to that one in 
the theorem 3 while the proof concerning an extremal with A = A+ is identical to that 
one in the theorem 1. 

Finally, in this sub-section, I shall say very briefly about a problem of the MPDTP 
i ^ j a both i and j are non- stationary point^. This case has certain differences from 
the case when at least one of states is a stationary point. Thus, the MPDTP may not 
obligatory follow the saddle Si. Rather it may be a path with a single A (rather than 
with A switching in the saddle Si from A = to non-zero A). Such transition takes a 
finite time even if a maximum 5*1 is smooth. In the case A > 0, this time is less than tp 
(3.30). In fact, most of the above-said in this paragraph concerns also a transition within 
one and the same basin of attraction. 

3.3.2. Action 

^"^This case is more of a formal rather than practical interest: if we consider a transition from an 
infinitesimal vicinity of i then, with an overwhelming probability, the system will move first to an attractor 
and, only from there, will transit to j, without ever return to the infinitesimal vicinity of i. However 
if one seeks the most probable fluctuational transition from an attractor to j which would obligatory 
follow i then the variational problem for the MPDTP i j is important. This can be necessary at an 
evaluation of a prehistory probability density |Q (c.f. also [|5l|). 
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The final goal of the variational problem is action S'min (3.18) which, as it has been 
found in previous sub-sections, can be presented in any of two forms (3.33) in which 
qoptif) is sewed from trajectories of the type (3.23) with T'{t) (3.28) in accordance with the 
algorithm described in the previous sub-section. I emphasize that the numerical procedure 
is incomparably easier than a direct numerical solution of the variational problem (c.f. 
|3T| ) and takes typically very little computer time. 

In some ranges of friction, action can be found explicitly. Thus, if 5*2 belongs to a 
basin of attraction of 1 then the MP DTP 1 — 5*2 is just time-reverse to the relaxational 
trajectory ^2 ^ 1 while action is just a difference of energies, f/^j — f^i- If 5'2 does 
not belong to a basin of attraction of 1 and friction is much less than characteristic 
eigenfrequencies, one can obtain explicit asymptotic formulas for action which will be done 
in Sec. 3. 3. 3. If F is slightly less than the upper limit for an existence of the MPDTP, 
Tq, then the MPDTP is close to 1 Si ^ 2 S2 and action is: 

^min(l ^ ^2) ~ Us, -Ui + Us, -U,, < To - r « To. (3.56) 

If r > To then a direct transition rate ais, (as well as 0:13 in phenomenological formulas 
of Sec. 2) is equal to 0: 

ai5, =0, r > To. (3.57) 

Generally, 5*111111 is to be calculated numerically. For the potential shown in Fig.4, 

f/(g) = 0.06(g + 1.5)2 -cos(g), (3.58) 
we plot in Fig. 6 an excess of action over the difference of energies 0: 



A^min = 5min(l - ^2) " (^& ' ^i) = ^ dt{T - F' (t))24,(t,, - t) . (3.59) 

A magnitude of AS'min varies fromQ to Us-, — U2. The latter is approached as F ap- 
proaches the critical value Fq at which a direct path disappears, as described in the 

^^Note that action for the reverse transition is equal just to AS'min: 5min('5'2 ^ 1) = A5min- 
^^If Us-i was smaher than Us, then the lower value of AS'min would be Us, — Us^ ■ 
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theorem 3, and which is equal in this case (as well as in a majority of other cases) to a 
doubled frequency of eigenoscillation in a bottom of the well 2: 



To = 2n. (3.60) 

In the underdamped range, F < Fi, which is described by the theorem 1, the depen- 
dence AS'jnin(r) undergoes characteristic oscillations (the inset shows them in an enlarged 
scale) which correspond to an alternation of ranges at which 5*2 belongs to a basin of atrac- 
tion of 1 with ranges at which it does not. The ranges are separated by critical values F„ 
which correspond to saddle connections 5*2 ^ 5*1 consisting of n passages {n = 1,2,...). 
Each oscillation has a cusp- like singularity in its maximum which corresponds to a jump- 
wise switch of the MPDTP between paths corresponding to and A_ (c.f. a disconti- 
nuity in a first derivative of nonequilibrium potential ||26| and a fluctuational separatrix 
for optimal paths in a phase space [Q). 



The range of moderate friction, Fi < F < Fq, is described by the theorem 2. A major 
variation of action occurs within just this range: the larger F the deeper into the well 2 
the MPDTP 1 Si ^ 5*2 falls and, correspondingly, the larger A5'min- 

3.3.3. Underdamped regime 

The goal of this sub-section is to derive explicit expressions for action and MPDTP 
in the case when F is small: 



P ^ — ^(,) (2), « 1, (3.61) 

mm[uJosc, ^osc, UJosc) 

where uJosc, i^osL ^fsc characteristic frequencies of eigenoscillation at energies between 
saddles and in wells 1 and 2 respectively. 

(a). Noise- free trajectory 

First, it is necessary to derive a formula for a critical value F = F„ which lies in 
the underdamped range (3.61) and provides a saddle connection 5*2 ^ 5*1 with a given 
number of passages n. I shall derive also TIj'qI clS cLll explicit function of F. Integrating the 
equation for the energy along the trajectory, (3.34), in which A = (i.e. T'{t) = F„) and 
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allowing for a smallness of r„ due to which energy may be considered as a constant at an 
integration of the left-hand side (3.34) along one passage, we obtain for a dissipation of 
energy along a given mth passage of a noise-free trajectory: 



AEm = Em — Em+1 = 7rTnI{Em), (3.62) 

m < n — 1, 

where E^, is an energy in the beginning of the passage while / is a mechanical action 

HE) = dqq, q = p{E-U{q)). (3.63) 

For the last (i.e. nth) passage, we obtain similarly: 



AEn = En- Us, = nTJk , (3.64) 

9(2) -g(i) , 



s = sgn 



^g(2)-g(52)" 

where Ii = Ii{Usi) and I2 = hiPs,) are actions (3.63) in wells 1 and 2 respectively. 

Dividing the eq.(3.62) by 7rr„/, applying the resulting equation to the first n — 1 
passages, summing up the results, exchanging the summation by the integration (the 
latter operation is justified by a smallness of AE^) and allowing for (3.64), we derive 



Allowing for 



we derive 



1 r^s2 1 

- / dE——— = n-l. (3.65) 

71 JUs,+-KV„h I[E)Tn 



1 rUs-,+TTr„ik 14 1 



from which 
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i+(£i " -"^si ^y^> 



If 

r e]r2/+(i+s)/2+i, r2/+(i+s)/2[, ^ > o, (3.69) 

then 5*2 ^ goes just to 2 rather than to 1 and a number of passages in 5*2 / is 

n,e; = 2Z + l + (l + s)/2. (3.70) 
It follows from (3.68)-(3.70) that 

n.e. = 2(4-) + l) + i(l-(-l)4^'-^-'), n^'^[\i^^ ^^^j^,j^y )l (3-71) 
s(-l)"-i = +1, 

where the square brackets [...] denote an integer part and the lower equality chooses those 
ranges of friction at which 5*2 ^ goes just to 2 rather than to 1 (note that, in these ranges, 
rirei is odd if q{2) is between q{l) and q{S2) and even otherwise). 

(b). Action 

Let us find an explicit dependence of action on friction, in ranges (3.69). The MP DTP 
necessarily follows 5*1. Action along the bit 1 ^ 5*1 is equal just to a difference of energies 
Us^—Ui and, hence, a non-zero contribution into A^'min is made only by the bit ^ S'2. 
Allowing for this and using the identity (3.34), we may write (3.59) as 

where r'{E) is the auxiliary friction r'{t) (3.28) expressed as a function of energy E{t) 
along the auxiliary relaxational trajectory 5*2 Si (3.23), (3.28). 

In order to find T'^E) one needs to find E(t). In a general case of an arbitrary F, the 
function E{t) cannot be found in an explicit form while, in an underdamped case (3.61), it 
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can be found explicitly in the relevant range of energies. Indeed, the characteristic time- 
scale on which both T'{t) and E{t) may change significantly is F"^. Correspondingly, in 
accordance with the conventional averaging method changes of energy on smaller 



time-scales are not essential for r'{E). In the underdamped case, F"^ is much larger than 
a characteristic duration of one passage]^ which is equal approximately to half a period of 
eigenoscillation at an average energy on the passage. Correspondingly, a change of energy 
along one passage is small while the dynamic equation (3.34) (which is obeyed by energy 
along the trajectory) may be averaged over a passage or, equivalently, over a period of 
eigenoscillation. Thus, averaging the eq.(3.34) over a passage, allowing for 

f = Iuj, (3.73) 

where the overbar means an averaging over an oscillation while / and uj are respectively 
a mechanical action (3.63) and frequency of eigenoscillation at a given energy E, and 
transforming from E to I (note that dE/dl = uj [§^), we obtain 

§ = -r'/- (3.74) 

After the substitution T'{t) (3.28), the eq.(3.74) can be integrated explicitly: 

I = /,=oe-/o -^^r'M = /,=oe-^*(^^3^)^ It=o = HUs,). (3.75) 

Expressing from (3.28) e^* via F' and substituting it into (3.75), one obtains 



4A 

from which it follows 



nUs,)T7T[^^^, j^, (3.76) 



r _ r{E) 



1 ^ " . (3.77) 



F F ^ I{E) {1-Ay 

^^In case of smooth maxima 5*1 and 5*2, the present consideration does not cover the very beginning of 
a first passage and the very end of a last passage i.e. the very vicinities of S2 and Si respectively: their 
contribution into action is negligible as it will be shown in the end of the sub-section. 
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Thus, in order to find F' as a function of energy along the trajectory we need only to 
find A. It should be found from that condition that a trajectory 5*2 goes just to 5*1, 
moreover, a number of passages should be equal to either rirei (3.71) or rirei — 1, for A_ 
and Aj^ respectively. To find A± I use equations analogous to (3.62)-(3.67) which were 
used in order to find r„ and nre/(r). The only difference is that I put in T'(t) A = A± 
instead of A = and, correspondingly, r„ should be exchanged by T'{E) (3.77) while n 
should be exchanged by rirei (3.70) or rirei — 1, for A_ and A+ respectively. Thus, instead 
of (3.67) for the case A = 0, I obtain for A± the following equation: 



1 /-f^Sa 1 11 

-/ dE - =n,e/--(3±l). (3.78) 

Generally, the integral in (3.78) cannot be found explicitly since I{E) (3.63) is typically 
a complicated function which can be presented only in an integral form. At the same time, 
in order to find A± explicitly we do need to express the integral as an explicit function of 
A±. Fortunately, in the underdamped case (3.61), one can split the whole variety of U{q) 
into such two complementary classes of functions that an approximate value of A^ can 
be found from (3.78) explicitly for both classes. Obviously, the results match each other 
on the "boundary" between the classes. 

All potentials U (q) are splitted into the two classes by a very simple condition: whether 
at least one of wells is deep or not i.e. whether the parameter 

^ „ (3.79) 

Us^ - mm([/i, U2) 

is small or not. 

1). Let us first consider the case when at least one of wells is deepQ: 

^"^The case when the weh 1 is not deep while 2 is seems to be the most interesting case in the generahzed 
Kramers problem, both in the underdamped regime and in general: 1) though, after an escape from 1, 
the system will most probable slide down into 2, a period of stay there may be so long that it will exceed 
a realistic duration of an experiment; thus, the flux from a metastable part of potential will be formed 
on the time-scale of such experiment only by transitions which do not follow 2 and just such transitions 
possess interesting features which form the main subject of this paper, 2) the ratio between a maximal 
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/X < 1. (3.80) 

In this case, a variation of / within the region of integration (3.78), [UsnUs^], is 
small and therefore T'{E) may be considered approximately as a constant, from which it 
immediately follows that, at F < Fi, 

r'{E) = F± = F„^^,_(i±i)/2 (3.81) 

(corresponding to A = A± respectively) where rirei is given by (3.71) (equivalently, F± 
may be found from (3.68)-(3.70)). Substituting (3.81) into (3.72), we obtain 

AS„,„ = ^!^i^mm(ii:^,fi:^). r<r.. (3.82) 
Similarly, at F > Fi {A^ does not exist in this range of F), 

A5^in = ^^^^^^^^^, F>Fi, /.«1. (3.83) 

If, apart from the constant (zero-order) term, we took into account in the Taylor 
expansion of T'{E) a next term we would obtain corrections to AS'min (3.82) and (3.83) 
of the order of /j? and respectively. Taking into account that an accuracy of the 

averaging method is of the order of /3 (3.61), the overal inaccuracy of (3.82), (3.83) is 

r ~ max(/3,/x2). (3.84) 

For the potential (3.58), an asymptote (3.82), (3.83) is shown in Fig. 6 by the dotted 
line: it well approximates the exact action within the accuracy (3.84). 

In addition, I present explicit expressions for constants A^, A_ which have an accuracy 
~ max(/3, n) and will be used further in an explicit formula for the MP DTP: 

F+-F 

magnitude of oscillations of action (sec below) and the Arrlienius factor (just the difference of energies 
^Ui) is in this case the largest possible, as it will be shown below, 3) the deeper the well 2 the larger 
a range in which action varies as friction varies from small to large values. 
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2). In the case when neither of wells is deep i.e. 



(3.86) 

the condition of small friction (3.61) is equivalent to the condition of a large rirei, 

1 ^ ^osc. Us2 -min([/i,[/2) 

1 < rirei ~ -f^lHTT . (3.87 

r Us, - mm([/i, U2) 

Then, as it is obvious intuitively and will be confirmed by a result, a deviation of V 
from r in the relevant range of energies is small so that \A±\ is small too, 

< 1. (3.88) 
Correspondingly, we may approximate F'/F (3.77) by the expression 

~ l + 2:?^^^±, 2^^^^A±<^1 (3.89) 

(the latter inequality will be checked after the result for A± is obtained). 

Similarly, if to expand the integrand in (3.78) into a Taylor series over A± and omit 
all powers higher than the first one then we can easily express A± from the resulting 
approximation of (3.78) as 



1 r^s2 1 
Au' = - dE 



Urel > 1- 

The expression in braces does not exceed 1 and therefore, allowing for (3.86), 

A. i « 1. (3.91) 

Thus, both the condition (3.88) and the inequality in (3.89) are confirmed. 

Substituting A± (3.90) into f' (3.89) and the resulting f' into AS^in (3.72), keeping 

only the lower power of n~J cx F, integrating the resulting integrand and choosing a 
minimum between the resulting actions for A- and A^, we obtain 
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A5^in = -^^^(|^^-n,e/ + l|-T^)', rirei^l. (3.92) 
An inaccuracy of (3.91) 

r -max(/3, -). (3.93) 
A* 

If both the condition of deep wells (3.80) and the condition of large number of passages 
(3.87) are satisfied i.e. if /3 ^ <S 1 the expressions for A±, (3.85) and (3.90), and for 
action, (3.82) and (3.92), give identical results up to the leading terms (a relative difference 
due to higer-order terms is ~ max(n~^, /x^)) and this provides a "bridge" between the 
results for the cases of deep and non-deep wells. Moreover, accuracies of asymptotic 
expressions also can be matched on the boundary between the cases, namely at 

/3 < /^^ ^ 1. (3.94) 

Thus, keeping at the treatment of the case (3.86) a next term in all relevant Taylor 
expansions on F, we derive a more accurate formula for AjS'min: 



A^^in = min(A5S, A^^t)), A^Si ^ Ia^'^'^I + ^TaT^^^^' ^^'^^^ 

OSC \ Oi 



osci 



AuJosC 1 A // 1 /■^•^2 1 

d±^—^ rirel + 1 ± -, , I, , ^^osc=- "-^7^' ^rei > 1- 

i + it JUs^ 1 

An inaccuracy of (3.95) 

r ~ max(/3, ^) ~ (3. (3.96) 

In the case ^ 1, in order to keep an inaccuracy on the minimal possible level (i.e. 
~ (5) at any F from the underdamped range (3.61) one may use the formula (3.95) at 
/3 ~ //^ while the formula (3.82) may be used at /3 ~ yi^. 

Finally in this sub-section, let us show that corrections determined by close vicinities 
of smooth maxima Si and S2 are exponentially small in the underdamped case. 

Let us first consider a contribution into action from a bit of a trajectory S2 "^-^^ 5*1 
close to the upper saddle, 5*2. In principle, one could calculate this contribution explicitly. 
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Indeed, in order to find a time dependence of energy on tlie trajectory, we can use tfie 
original (i.e. non-averaged) equation (3.34) for dE/dt wliile q in tlie left-liand side of this 
equation can be calculated in the dissipationless approximation in which, besides, the 
potential U{q) may be approximated by the inverted parabola, 

U{q) ^ -\^U<1 - 1(32)?, \q - q{S2)\ « ^(^2) - q{Si). (3.97) 

However, in comparison with an inaccuracy of the averaging method (~ f3), the explicit 
account of the contribution from the vicinity of 5*2 makes no sense because the contribution 
from this region into action is exponentially small. Indeed, on the first passage, the 
approximation (3.73)-(3.77) (based on the averaging method) is valid starting from such 
point P on the trajectory that a time of relaxation from this point to the lower end of the 
first passage is much less than F"^. We may estimate roughly this time as F^^. Then, one 
can easily show, using the dissipationless approximation, that a coordinate of this point 
is exponentially close to the saddle: 



q{S2) - q{P) ~ (g(52) - g(Si))e-'^^, a ~ 1. (3.98) 



Correspondingly, 



^(^2) - E{P) ~ {Us, - U2) e-''^— , a ~ 1. (3.99) 

Taken that ujs, ~ ^osc-, a contribution of the vicinity of 5*2 into action is exponentially 
small and may be omitted within accuracies of formulas (3.82), (3.92), (3.95). 

As concerns the analysis of the contribution from the discussed vicinity of the lower 
saddle. Si, it is more complicated and involves, in particular, an analysis of the singularity 
of the trajectory (c.f. the Appendix D) but the ultimate conclusion is the same: the 
contribution from the vicinity of 5*1 is exponentially small and may be omitted. 

(c). Most probable direct transition path 

Let us derive an explicit expression for the MPDTP in the underdamped regime. 
If to make in the dynamical equation (3.23) the transformation of variables from the 



coordinate-velocity q-q to action-angle I-ijj we shall derive such dynamical equations [TO 
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r' • da 

I^--q', ij^uj + r'q-^, (3.100) 



where 



q = q{I,iP) (3.101) 

is coordinate as a function of a mechanical action and of an angle: it is periodic on ip 
with a period 2% and its concrete form depends on a concrete shape of a potential U (q) . 

The averaging transforms the first of eqs.(3.100) into the eq.(3.74) while the another 
equation is transformed into 

tjj^uj. (3.102) 

The latter equation is readily integrated: 

= iPit) = + r dTUj{I{T)), (3.103) 
Jo 

where I{t) is given in (3.75) while ipo, together with /(t/gj); corresponds nearly to 5*2, 



q{I{Us,),^o)^q{S2) (3.104) 

(the expression "nearly 6*2" means here a state P from (3.98), (3.99)). 
Thus, it follows from (3.23), (3.75), (3.103), (3.104) that 



qoptit) ^ qil{t - trel),1p{t - trel)), 0<t< Uel, (3.105) 

where functions g, / and are given in the eqs. (3.101), (3.75), (3.103) and (3.104) 
respectively while trei corresponds to a relaxation (3.75) from /(C/52) /(C/5J: 

trel - ^In -J, , B = A+ 2/(C/5j ' ^^-^^^^ 

and A is to be chosen between A± (see (3.85) and (3.90) for cases of deep and non-deep 
wells respectively) dependently on which of them provides a smaller action. 

The formula (3.105) describes correctly nearly the whole MPDTP except the expo- 
nentially small vicinities of the saddles. 
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Chapter 4 



Discussion and applications 

In this section, I discuss briefly a few connected witli tlie present work items as well as 
applications whose detailed analysis is supposed to be done elsewhere. 
1. 

Let us demonstrate how results of Sec. 3. 3 can be immediately applied to the problem of 
inter-attractor transitions in a 3-well stable potential (c.f. Figs.2,3). First of all, we note 
that MP DTP for a transition attractor-attractor necessarily follows a saddle from which 
a system can relax noise-free to a final attr actor, so that the problem is reduced to the 
transition attractor- saddle. If the saddle belongs to a basin of attraction of the attractor 
then the problem is trivial: the MPDTP is just a path time-reverse to a relaxational 
trajectory while action is just a difference of energies in the saddle and in the attractor. If 
the saddle (let us call it S2) does not belong to a basin of attraction of the attractor (let 
us call it 1) then the problem is closely related to that one considered in Sec. 3. 3 which, in 
its turn, is reduced to the transition Si — > 82- However, in Sec.3.3, we considered only the 
case when neither of two noise-free trajectories emanating from Si reaches a coordinate 
q{S2). Generally speaking, it may be not so (if Us-^ > while friction is small). But, 
still, the problem is easily reduced to the case considered in Sec.3.3: due to the property 
of detailed balance, the MPDTP Si S2 is just time-reverse to the MPDTP S2 Si 
while if the transition Si — > S2 does not satisfy the above mentioned restriction then 
the transition S2 Si necessarily satisfies an analogous restriction required for it to 
be described within the case considered in Sec.3.3 (results of Sec.3.3 for a saddle-saddle 
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transition are applied to the transition 5*2 — * 5*1 if to exchange notations: 5*1 by 5*2 and 
vice versa); corresponding actions differ merely by a factor Us^ —Us2- 
2. 

Global bifurcations in a dynamical system {saddle connections) play a crucial role for 
various characteristics of fiuctuational transitions. Let us illustrate this for a system 
which possesses three attractors. Assume that a basin of attraction of an attractor 1 
possesses at a given friction only one saddle, 5*1. If to vary friction the connection to 
another saddle, 5*1 5*2, occurs at some friction which marks a change of a saddle via 
which the escape from an attractor 1 to an attractor 3 takes place (c.f. Fig. 3) and a 
corresponding switch of the most probable transition route [MPTR) (c.f. R in (2.26) and 
(2.30)). The connection Si ^ S2 leads also to sharp changes of the flux (c.f. (2.25) and 
(2.29)) and of the mean first passage time (MFPT) (c.f. (2.26) and (2.31)) [|. 

In potential systems, reverse saddle connections, Si, also play an important role 

for fiuctuational transitions. They mark switches of the MPTR: the ultimate transition 
occurs most probable from that potential well to which the trajectory emanating from 
5*2 relaxes (c.f. (3.15) and (3.16)). They also mark characteristic changes of the initial 
transition flux (0:13) which is well demonstrated by the inset in Fig. 6: critical values r„>i 
which correspond just to saddle connections 5*2 ^ Si separate ranges ]r2m+2, r2m+i[ in 
which MPDTP 1 6*2 is time-reverse to the noise-free trajectory 5*2 ^ 1 while action 
is equal just to the difference of energies — Ui from ranges ]r2m+3, r2m+2[ in which 
MPDTP necessarily follows Si while action exceeds — Ui. A maximum of each 
oscillation corresponds approximately to a largest distance from F to the nearest to it 
critical value F„. If to number oscillations from the right then, as it follows from (3.92), 
(3.69), (3.68), a magnitude of an mth oscillation decreases at large m by a quadratic law: 

A^irHH = —2 ,^.''^f:'ii.,2 ^ ^ » 1- (4-1) 

nn? 16Au;;,,(l + i^f 

^Obviously, a crucial for fiuctuational transitions role of saddle connections like those described above 
was found before in related problems: see e.g. | |47t where, in particular, a strong sensitivity of a probability 
of a multi-well jump in a tilted cosine potential to a tilt when it is close to the threshold for an onset of 
the running solution has been demonstrated. 
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The largest oscillation is the first one from the right i.e. in the range ]r3,r2[ (c.f. 
Fig. 6) for the case when s = +1 i.e. when q{2) is between q{l) and q{S2) (c.f. Fig.4) or 
in the range ]r2, ri[ otherwise (i.e. when s = —1). Its magnitude has the maximal value 
when a depth of the well 2 is much larger both than a depth of the well 1 and than a 
difference of energies in saddles since, just in this relative deviation of friction F 

from the nearest value providing a saddle connection 5*2 ^ Si is the largest. It is easy to 
derive from (3.82), (3.81) that 

AS^^r\m = 1) ^ A5^i„(F(--)) = (Us, - Us,) '^^f~'^ , (4.2) 



a = 



X , p(max) ^ ^r(i_s)/2+lF(i_s)/2+2, Us, " C/2 > Us, - Ui. 

\ i (l-s)/2+2 



It is interesting to note that AS^^^^^\'m = 1) differs drastically for the cases s = — 1 
and s = +1. It is demonstrated easier of all for the case 

Us,-U2 » Us,-Ui » Us, -Us, , (4.3) 

when a in (4.2) can be found explicitly: a = 3 if s = — 1 and a~ I + /2//1 ^ lifs = +1. 
Correspondingly, 

At small enough temperatures, oscillations of action lead to exponentially strong os- 
cillations of an initial flux. Note however that, in the case s = — 1, required for this 
temperatures should be very small, as obvious from (4.4), while, in the case s = +1, the 
first osciUation is much stronger and if h/h is large enough then A>5iT^(m- 1) may be 
much larger than the Arrhenius factor Us2 —Ui so that the oscillation of an initial flux is 
huge at any temperature from the relevant for the Kramers problem range T <^ f/^^ — f^i . 

As concerns the case s = — 1, a major variation of action occurs (monotonously) in the 
range [Fi, Fq]: A^'mm varies from to Us, — U2 (see Fig. 6) and, if (4.3) holds, the variation 
of action is much larger both than the Arrhenius factor and than the flrst oscillation (4.4). 
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I emphasise that, since the Kramers paper |0] , all works on the escape from a metastable 
potential (or on transition rates in a stable potential) considered only power-like depen- 
dences of the escape rate (flux) on friction|, while we have demonstrated that, in a multi- 
well metastable potential, the dependence of the initial flux on friction is exponentially 
strong, including in particular exponentially strong oscillations. 

Unlike potential systems, in non-potential or periodically-driven systems, switches of 
MPTRs and sharp changes in a flux and MFPT should not, generally, be associated 
with saddle connections 5*2 ^ Si. the detailed balance does not hold in such systems 
36| so that most probable fiuctuational paths are no longer associated with time-reverse 



relaxational paths and, hence, bifurcations of the latter do not give rise to bifurcations 
of the fiuctuational paths. Preliminary results for periodically driven zero- dispersion 
4^,[0,|^9| systems do confirm this [Q: a trajectory time- reverse to MP DTP in this 



multi-attractor system intersects a boundary of a basin of attraction of an initial attractor 
in a point which is not 5*1, so that saddle connections 5*2 ^ 5*1 may not lead to bifurcations 
of MPDTPs (but reverse connections. Si ^ 5*2, are still relevant). 
3. 

One more item which I did not touch so far but which should be discussed, at least briefly, 
concerns most probable transition paths with a given (rather than optimal) time of the 
transition. Such paths may be necessary for example for a calculation of a flux from 
any (both single- and multi-well) metastable potential at the very initial stage (before 
the quasi-stationarity within the initial well is formed). They are necessary also for a 
calculation of tails of a prehistory probability density ||3^, |5l[]. In such paths^ within 

one well of the overdamped double-well Duffing oscillator were considered numerically. 

^To the best of my knowledge, there was only one work, |Q (reproduced also in the review |^), in 
which some indirect and inexplicit evidence of a strong dependence of transition rates in a multi-well 
potential on friction was contained. However that work considered (by the method very different from 
mine) only some very particular case: an underdamped motion in a slightly tilted cosine potential close 
to the threshold for an onset of the running solution. And even for that particular case, the resulting 
expressions for rates of multi-well jumps were not analysed in details, while the Kramers problem for an 
escape from a multi-well metastable potential was not considered at all. 

•^They are called nonstationary optimal paths in [^Tl. 
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I note that the method described in the Sec. 3. 3 can provide more exphcit (rather than 
purely numerical) solutions of the Euler-Poisson equations, in much more general case: 
for an arbitrary potential and an arbitrary friction. With this aim, one should choose 
the type (3) of the solution (3.26) of the Euler-Poisson equation, unlike most probable 
direct transition paths considered in the present paper which correspond to the type (1) 
in (3.26). Indeed, if a time of the transition is fixed by us the minimization of action over 
a transition time (3.21) is not to be done and the condition (3.22), for a zero quasienergy, 
is no longer valid. In order to provide a given transition time it is necessary to fit an 
integration constant C in the solution (3) in (3.26). Unlike the escape problem, the 
problem with a given transition time reduces to three rather than two dynamic equations 
which, generally speaking, may display chaos, especially taking into account a singularity 
in the dynamic equation for F', at turning points of qopt{t). It would be very interesting 
to test this intriguing conjecture. 
4. 

One more promising application of the results of the present paper is an optimal control 



of fluctuations. As it was shown in ||23[, a deterministic field which is to be applied 
in order for either to enhance or to suppress a given fiuctuational transition optimally 
can be expressed explicitly via the most probable transition path at the absence of an 
optimal field, at quite general conditions. The papers p3|, dealed with transitions 
within one and the same basin of attraction (more exactly, from an attractor to a saddle). 
The general approach of the present paper based on master equations describing multiple 
returns between attractors in a multi-attractor system may provide a generalization of 
the methods of [^, for a case of multi-attractor systems. Besides, the exact solution 
of the variational problem in a multi-well potential system may be directly used in order 
to find the optimal field in such system. 
5. 

The next item which I shall discuss in this section concerns a noise-induced unidirectional 



motion in periodic potentials [T^ - |22]. The effect was originally considered for poten- 
tials asymmetric within the period ( "ratchets" ) - . It may arise also in symmetric 
potentials (e.g. 0]) and in periodically driven systems which lack spatio-temporal sym- 
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metry [^. If a periodic potential has more than one well within the period then the 



consideration should be similar to that one which was developed in this paper, using mas- 
ter equations governing a dynamics of first-order conditional populations of wells within 
one period of the potential. This could be especially relevant to the resonant directed 
diffusion in non-adiabatically driven zero-dispersion systems. It was found recently 
that the directed diffusion in periodic potentials driven by a non-adiabatic periodic force 
was enhanced significantly if the frequency of the force was close to the frequency of 
eigenoscillation in the potential at such energy which corresponds to the minimal abso- 
lute value of the derivative on energy \duj{E) / dE\. It obviously follows from results of 



22 1 that the most strong enhancement should be expected for zero- dispersion systems: in 



such systems, \duj{E) / dE\ possesses a zero(s) at some energy(ies) Periodic 
potentials which possess the zero-dispersion property have typically two or more barriers 
of different heights within each period and, thus, the analysis of the directed 



diffusion in such systems would need a use of the master equations. 
6. 

Results of Sec. 3 for the most probable transition path may be important for the escape 
problem in periodically driven multi-well potentials. Consider, for example, the periodic 
potential in Fig. 7. At an absence of the driving, an escape from each well to an adjacent 
period occurs most probable via the nearest high barrier (since a relaxation trajectory 
from the top of a higher barrier goes into just adjacent wells, in our particular example). 



Generalizing the results ||22[ (c.f. eqs.(6), (7) in 12^), one may conclude that action along 
MP DTP to any of barriers decreases at a driving by a periodic force F cos{VLt) {F > 0) 
by the factor 

-AS^ F\xm > 0, x{^) = / dte^'''—-Mm, (4.5) 

where q(t) and T'(t) are described by (3.23), (3.28) with A corresponding to each particular 
MP DTP. Values AS* differ for different MPDTPs and, generally, the sign of the difference 
between those corresponding to the transition to the nearest high barrier and to the far 
one may turn out opposite to the sign of the corresponding difference in the absence of 
the driving. For example, in the case shown on Fig. 7, it certainly occurs if ^ 1: AS is 
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larger for that MPDTP which provides a transition to the more far high barrier (c.f. ||22|| ) 
while, in the absence of the driving, action along this MPDTP is larger than along the 
another one, due to the absence of a relaxational trajectory. Correspondingly, at some 
critical value of the amplitude of the driving force, F^, two effects exactly compensate each 
other and the optimal path changes jump-wise: for F > Fc, the escape occurs via the 
more far high barrier, unlike the undriven case, and in order to calculate its probability 
one should use results of Sec. 3 of the present paper. 
7. 

Finally, I would like to draw readers' attention to possible applications of results of the 
paper to two important objects described as potential systems. One of them is a biased 
Josephson junction which is described by a "washboard" potential This system 
was investigated by many authors. In particular, a stationary distribution (which accounts 
for escape rates both from the running regime and from the locked one) was investigated 
numerically in using the formulas equivalent to our (3.23), (3.28) (note also the 
explicit expressions for the escape rates in "underdamped and low-bias" case 
and expressions in quadratures (though quite complicated) for transition rates in the 
underdamped case with the tilt close to the threshold for an onset of the resistive state 
as well as various numerical studies 0], [^, [^, [0]). However the problem for 
the transition (rather than escape) rates at arbitrary friction and bias was not considered 
and results of Sec. 3 can be used for this (see also the discussion above). Note also that 
the developed here method (slightly modified for the application to this problem) could 
provide an easy and reliable numerical procedure for a calculation of transition rates from 
the running solution (as well as the associated "nonequilibrium potential" [^) while the 
authors of ^6] reported an instability and non-reliability of numerical results obtained by 
their method. 

The another important relevant application concerns ionic channels |]5^ , . Motion 



of ions in channels may be described in some cases as an underdamped motion in a 
multi-well potential so that results of the paper may be relevant to this system. 
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Chapter 5 



Summary 

1. 

There has been introduced (see Sec. 2) a splitting procedure for a phenomenological 
treatment of inter-attractor transitions in a multi-attractor system driven by a weak 
noise: an integral fluctuational transition flux is splitted into partial ones corresponding 
to different numbers of returns from a final attractor which may occur before an ultimate 
transition at a given instant. Such splitting allows to describe a dynamics of first-passage 
and prehistory problems by certain master equations whose solutions in terms of direct 
inter-attractor transition rates aij are found explicitly. Examples have been analysed and 
a non-triviality of some of results has been demonstrated. 

2. 

The classical Kramers problem for the escape from a metastable single potential well 
has been generalized for a case of a multi-well metastable potential. If friction does not 
exceed certain limit a dynamics of the escape is described by means of master equations 
mentioned above and has more than one exponentially long time-scale, unlike the conven- 
tional case . At the smallest of these time-scales, a system transits from an initial well 
1 directly (i.e. not following intermediate attractors) to that saddle 5*2 from which it can 
leave a metastable part of the potential noise-free. Thus, the escape flux at this stage is 
equal to a transition rate ais^- 

If 5*2 does not belong to a basin of attraction of 1 (c.f. Fig.4) then such transition 
cannot be described by a conventional time-reverse relaxational path because the corre- 
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rel 

sponding relaxational path just does not exist: 5*2 7^ 1. In order to find the most probable 
direct transition path {MP DTP) 1 —>■ S2 and action along it (the latter determines with 
a logarithmic accuracy a transition rate aisj) I have found direct extremals of the varia- 
tional problem for an extremum of action i.e. extremals which do not follow intermediate 
attractors (see Sec. 3. 2). The solution is valid for an arbitrary potential and an arbitrary 
friction parameter. It may consist either of a single bit of certain type (see below) or of 
bits of this type sewed together in saddles while each bit is a path time-reverse to the 
auxiliary relaxational trajectory (3.23) corresponding to a time-dependent friction (3.28) 
in which a constant A is to be chosen in such a way that the relaxation from an end of 
the bit to its beginning is provided. 

The described above type of a single bit in the MPDTP is equivalent to that one 
obtained in |2^ by a different method and in a different context. But in order to find the 
MPDTP it is particularly important to know how to choose among an infinite number 
of direct extremals just that one which provides a minimal among them action. Authors 
of p6| considered the latter problem only for one specific potential, namely a tilted cosine 
potential. Moreover their choice of a proper extremal was based mostly on intuitive 
arguments. 



In contrast with p6|, I provide a complete mathematicaly rigorous analysis of the 
discussed above transition 1 — 5*2 when just two wells of arbitrary forms are involved 
(the number of wells is restricted by us to two just for the sake of clarity and brevity 
while a generalization to a larger number of wells is straightforward). First, the MPDTP 
follows a conventional escape path from an initial attractor 1 to a saddle of its basin of 
attraction, 5*1, i.e. a path time-reverse to the noise-free trajectory Si ^ 1. The main 
problem was to find the bit of the MPDTP between saddles. Si —>■ 5*2. All possible 
cases are covered by theorems 1-4 in Sec. 3. 3.1. A typical MPDTP is shown in Fig.4. 
The theorem 3 states that if friction is not less than certain critical value Fq (which is 
typically equal to a doubled frequency of eigenoscillation in a bottom of the well 2) then 
the MPDTP Si S2 does not exist at all i.e. ais2 = in this case. 

A calculation of action S^i^ along the MPDTP is provided by a simple numerical 
procedure which is incomparably easier than a purely numerical solution of the variational 
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problem for a minimum of the action functional (c.f. |^) and, besides, our procedure 
provides a true solution for certain while the latter procedure as well as a purely numerical 
search of the constant A in (3.28) (c.f. [^) may miss an absolute minimum. 

Thus, / have found with a logarithmic accuracy a complete solution of the generalized 
Kramers problem in all ranges of friction (which have been distinctly separated). Un- 
like most of previous works on the escape from a metastable potential, in which only a 
power-like dependence on friction was found (note the footnote 2 in Sec. 4), it has been 
demonstrated in the present paper that, in the case of a multi-well metastable potential, 
the dependence on friction can be exponentially strong, at small enough temperature. 

3. 

In the underdamped range, both MPDTP and 5'min have been found explicitly for an 
arbitrary potential (see Sec. 3. 3. 3, c.f. also an asymptote in Fig.6). 

4. 

Generally, global bifurcations in dynamical sjstems{saddle connections) drastically in- 
fluence fiuctuational transitions, at a weak noise added, especially in potential systems. 
At small enough temperature, this gives rise, in particular, to the characteristic expo- 
nentially strong oscillations of an initial flux from a multi-well metastable potential as 
a friction parameter varies (see an example in the inset in Fig.6, see also the item 2 in 
Sec. 4). Maxima of oscillations are cusp-like which corresponds to a jump-wise switch 
of the MPDTP (c.f. a line of discontinuity for a non-equilibrium potential and a 
fiuctuational separatrix for optimal paths |Q, [0). 

5. 

Results for the Kramers problem, listed in items 2-4 above, can be easily generalized 
for the problem of inter- attractor transition rates in a stable multi-well potential system 
(see the item 1 in Sec. 4 for the case of 3-well potential). 

6. 

I have sketched applications to various other problems: short-time dynamics of large 
fluctuations, prehistory probability density, optimal control of fluctuations, noise-induced 
transport in ratchets, escapes in a multi-well potential at a periodic driving and inter- 
attractor transitions in biased Josephson junctions and ionic channels. 
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Appendix A 



The master equations which govern partial populations of the nth order for the transition 
1^3 (i.e. such populations which account only for those realizations of noise at which 
the system being initially at 1 visited 3 before a current instant n — 1 times) are the 
following at n > 2, 



at 

^^2" ^ a,,wi''^-{a2, + a,,)wt^ + as2Wt\ (A.l) 



dt 



dt 

Wt\0) = 0, i = l,2,3 
where the flux of the (n — l)st order 



= arsW^-'^ + a^sW^-'^ (A.2) 



is assumed to be some known function of time (see below) . 
The equation for Wg"^ is separated and easily solved: 



\t) = I c^Tj("-^)(T)e-("3i+'*32)(*-^). (A.3) 

JO 

Substituting (A.3) into (A.l), we obtain for W^^'' and H^s"^ a closed system of two 
linear inhomogeneous Ist-order differential equations whose solution, with the account of 
the initial conditions (A.l), is the following: 
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=La„,)=Wi +Ws , (A.4) 



Jq Jo 



- (fc(-'')a3i-«32)(kJ 
^(M)^_^£ ^ ^3 = (a;3i + «32) \ 

"21 

where ti,ts are defined in (2.7). 

(n) 

Taken that J(^) IS given by (2.8), W and J(") can be found explicitly for any n >2 
by the successive application of formulas (A.4) and (A. 2), integrating explicitly at each 
successive step exponential terms in the integrand. For example, 



J(^) = jf) + Jf), (A.5) 

(2) ^ K3 + a23fe('-))(a3lfe^-')-a^^ 1 _ 1 _ + 



''S ^S,l ^l,S ''3,1 ''1,3 ''3 

ci = ai^ai + 0L2Z0L1, Cg = ai3 - ci, 

where q;i,2 are defined in (2.7). 

Two most essential differences of higher-order partial fluxes from J^^^ are the following: 

1) j("^2)(o) ^ while J(i)(0) = q;i3 (J^"^^) oc at small t); 

2) an additional time-scale is present in the dynamics of J*-"-^-'(t), due to that an escape 
from the final state of the transition, 3, is involved, unlike the case of J^^\t); for example, 
if ^3 ^ ti^s then just higher-order fluxes prevail over the first-order one, at t t^. 

In order to demonstrate more clearly a non-triviality of the above method let us con- 
sider briefly the simplest multi-stable system - the system with just 2 states. Introducing 
direct transition rates Q;i2,ci;2i, conditional populations Wi^2 ^-^id partial fluxes for the 
transition 1 — > 2 

ji-){1^2,t) = a,2Wi''\ (A.6) 
we can write for them the following master equations: 
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dt 



(A.7) 



dt 

__ = _a2iW^2 + "12^"! , (A.8) 
n>2. 

The solution of (A.7) is a well-known result 

iyf)(t) =e-"i2*. (A.9) 

It corresponds to the flux 

J(i)(t) =ai2e-"i^* (A.IO) 

Obviously, the flux (A.IO) coincides with the conventional result for the flux in the 
escape problem 0. At the same time, the case n > 1 was not considered before, to the 
best of my knowledge. The solution of (A.8) is 

JO JO 

Using the solution (A.9) for substituting it into (A. 11), performing the inte- 

gration, and then repeating this as many times as necessary, one can obtain an explicit 
expression for any order of W^"^ and therefore for the corresponding flux (A. 6). For 
example, at ai2 7^ a2i, 

j(2)(^) = ( V ^ e-"-*(t(a2i - «i2) - 1)). (A.12) 

E.g. if 0^21 <^ «i2, then J*^^^ significantly exceeds J^^'' already at t > a]^2^ In(ai2/Q;2i) 
which reflects that fact that the state 1 is nearly depleted at this time-scale and the only 
possibility for a system to be in 1 may be for an account of rare returns from 2. 
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Appendix B 



I shall derive in this Appendix the eq. (3.25). 

First of all, let us write down explicitly the partial derivatives of L (3.18), with qopt{t) 
as an argument: 



dL _ dL 



qopt{t) — ^~^\qopt{t)-, (B.l) 



dL ^ d^Ujqopt) dL 

Let us put (B.l) into the Euler-Poisson equation (3.20), exchange the "bhnd" time 
variable t for tfr — t, use the definition of qoptit) (3.23) i.e. exchange qoptittr ~ t) ioi q{t) 
(3.23), and take into account after this the symbolic relation 



d d 



d{ttr — t) dt 

Then we shall derive 



(B.2) 



^fQ__-^dq^ dU{q) 
dt"^ dt dq ' 

where q = q{t) satisfies the equation of motion (3.23). 

Allowing for the eq.(3.23) for q, the identity in (B.3) can be written as 
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V^-{T + T'{t))f^. (B.4) 



Substituting (B.4) into the equation for rj in (B.3), allowing for 

<fU{q)dq d .dU{q) 



dq^ dt dt dq 

and using (3.23) again, we obtain 



), (B.5) 



((rW-r-2^)g.,m^-^)§^o. ,B.) 

Carrying out the differentiation of in (3.25) explicitly, one obtains the equation 
identical to (B.6). 
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Appendix C 



The goal of this Appendix is to study a possibihty to sew together different "single- A" 
extremals. Let us consider the functional (3.18) and assume that there is an extremal 
(i.e. a trajectory providing an extremum of the functional) qe{t) which is sewed in some 
intermediate point of the phase space (gj„, gj„) from trajectories of the type (3.23), (3.28) 
with different A. By the definition, qe{t) must satisfy the condition of the equality to zero 
of the variation of the functional: 

c-^ „ /■**'■ , rdL ^ dL ^ . dL /^.x 

5S = 0, 5S= dt[—5q + —5q + —5q]. C.l 

JO oq oq oq 

Let us divide the whole interval of integration in the integral (C.l) for three parts: 

6S= ...+ / ...+ / (C.2) 



10 Jh„-At Jti„+At 

where Un corresponds to the intermediate point (qeitm) = qinAe{Un) = qin) while At 
is some arbitrary small interval. If to repeat for the first and third integrals the same 
procedure as is conventionally used ||3^ at the derivation of the Euler-Poisson equation 
(3.20) (i.e. to carry out an integration by parts twice) and to take into account that the 
Euler-Poisson equation is satisfied for (3.23), (3.28) everywhere except possibly tin we 
shall obtain [| 



5S = (C.3) 

^We do not vary tin and tt^ in S because solutions (3.23), (3.28) necessarily satisfy the condition (3.22) 
and, thus, the corresponding variations are equal to zero. 
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If to make At infinitesimal the integral in (C.3) vanishes. Allowing also for that 
qe{t), qe{t) should be continuous everywhere (otherwise a random force (3.6) would become 
infinite) i.e. 



Sq\u„-At = Sq\u„+At = Sqin, 

H\tir,-At = Sq\t^^+At = Hin, (C.4) 

At 0, 



we derive 



SS 



(C.5) 



Sqir. 

5qir, 



'dL. 
dq 



I ^in 



dL. 
dq 



kin + At 



+ 



dL dL d .dL d dL 



Coordinate and velocity are varied here independently. Hence the variation 5S is 
identically equal to zero only if the expressions in the square brackets are equal to zero. 
With the account of that the following equalities are satisfied on the extremal, 



dL 1 . / V dL BL 



(C.6) 



and allowing for the continuity of q'e(t), the condition for the equality to zero of the 
expressions in square brackets in (C.5) can be written as 



[^\ttr - tin + At) - r'{ttr - t^^ - At)]q,{tin) = 0, 
t\ttr - tin + At) - t\ttr - tin - At)] qe{tin) + (C.7) 
(r + T'{ttr - tin - At))qe{tin + At) - (F + V {ttr - tin + At))qe{tin - At) = 0. 

By the original assumption, the values of A in V (3.28) are difi^erent at tin — At and 
at tin + At, which means that 
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T'iUr - tin + At) ^ T'{ttr - Un - At). 



(C.8) 



Then, the first condition in (C.7) can be written as 



Qeitin) = 0. 



(C.9) 



If dU/dq is continious then it follows from (C.9), (3.23) and from the continuity qe{t) 
that qe{t) is continuous in tin as well: 



If T'{ttr—tin — At) and T'{ttr—tin+At) are finite then, with the account of (C.8)-(C.10), 
the second of the conditions (C.7) is equivalent to 



With the account of (3.23), conditions (C.9), (C.ll) are equivalent to (3.32). 

For that case when, at least for one of sewed extremals, V turns into infinity in 
the sewing point (c.f. Appendix D) then even a satisfaction (C.ll) may not provide an 
equality of the variation 5S to zero. However, it is shown in Sec. 3. 3.1 that, for a transition 
from an attractor corresponding to a a bottom of one of wells to a state which does not 
belong to its basin of attraction, an extremal which provides an absolute minimum of 
action necessarily follows the saddle of the basin. Thus, in this case, the MPDTP is 
necessarily sewed in the saddle from "single- A" extremals with different A. 



Qeitin - At) = qe{tin + At) = qe{tin)- 



(C.IO) 



Qeitin) = 0. 



(C.ll) 



67 



Appendix D 



The trajectory (3.23), (3.28) is analysed below in the context of an existence the pole tp 
(3.30) (correspondingly, A will be assumed positive unless it is specified otherwise). 
Let us recon a time from tp-. 

T = t-tp (D.l) 
Then, (3.28) and (3.23) can be written respectively as 



f(r) ^ r'{t) = r\±^, (D.2) 



q + r{T)q + dU{q)/dq^O, (D.3) 
q{r)=qit). 



It is easy to see that 



f(-r) = -f(r), (D.4) 



If to denote 



g_(T) = g(-r) (D.5) 

we shall obtain for q-{r), with the account of (D.4), the same equation as for ^(t) (i.e. 
(D.3)). Thus, if the initial conditions coincide i.e. if 



g_(0)=g(0), L{0)=m, (D-6) 
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and if the equation (D.3) with such initial conditions has a unique solution then the 
trajectory for positive r is just time-reverse to that one for negative r 



qiT)=qi-T). (D.7) 
The condition (D.6) is satisfied only if 

g(0) = 0. (D.8) 

The condition (D.8) is obviously satisfied [| because, otherwise, q and q would diverge 
at r = 0, taking into account that r(r) diverges at r = 0: 

f(r) ^ --, |r| « ^. (D.9) 
r i 

As concerns the uniqueness of the solution, it depends on whether q{tp) is a stationary 
point of the original dynamic equation (with a true F) or not. Let us consider these cases 
separately. 

1). 

fl«o,#0. (D.IO) 
Let us expand the velocity into the Taylor series, 

^(r) =air + a2r^ + ..., (D.U) 
and substitute it into the eq.(D.3) Then, keeping the leading order in r, we obtain 

dU, , , 

= (D.12) 

^Note that the consideration similar to (D.1)-(D.6) is vahd for negative A too if to change tp by to 

(3.29). However, the condition (D.6) is not satisfied for negative A unless, incidentally, to corresponds to 

a turning point. Thus, typically, the trajectory does not follow "back in time", at negative A. 

■^Strictly speaking, one could try also an expansion q'(r) = 5(r)(aiT + a2T^ + ...) where 6(t) is a 

non-analytic function such that T6(r) ^ at t — > (e.g. 5(r) — ln(r)). But it is easy to show that the 

eq.(D.3) cannot then be satisfied. 
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The higher-order coefficients in (D.ll) can be easily (and uniquely) found using (D.3), 
(D.9)-(D.12) as well as higher-order terms in the Taylor expansion of rr{T). 

Thus, the trajectory is uniquely defined if (D.IO) holds and, therefore, (D.7) holds 
true in this case too. 

It is interesting to note also that the direction from which the system (D.3) arrives 
at the turning point (g(0), q{0) — 0) depends only on a sign of dU/dq\q(p). Thus, if 
the latter is negative while q{t = 0) > q{tp) then the trajectory should necessarily have 
at least one more turning point before (i.e. ect t < tp) in which a velocity changes the 
negative sign for the positive one. 

2). 

f l«o, = 0. (D.13) 
At small r, we may omit then the term dU /dq in the eq.(D.3) (which will be confirmed 
by the result) and obtain the closed equation for dq/dr which is easily integrated: 

^ = Cexp(- /dTf(T)). (D.14) 
dr J 

where C is an arbitrary constant. 
With the account of (D.9), 

f- ^ Ct\ (D.15) 
dr 

Correspondingly, 

q{T) ^ ^Cr^ (D.16) 

from which the validity of the omission of the term dU /dq in (D.3) if (D.13) holds follows. 

Taken that C is arbitrary, there is an infinite number of trajectories which satisfy both 
the equation of motion (D.3) and the initial conditions (D.8), (D.13). It follows from this, 
in particular, that (D.7) may not hold true. 

It is interesting also that, at any non-zero C, the trajectory (D.16) approaches g(0) 
(or departs from it) for a finite time. 
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Figure Captions 



1. A double- well metastable potential and schematically shown "direct" transitions: 
1^3 (dotted line) and 1^2, 2^1, 2^3 (dashed lines). 

2. Energy-coordinate plane. The solid line shows a 3-well potential U{q) (numbers 
indicate attractors, dots indicate saddles) while the dashed line shows a relaxational 
(noise-free) trajectory emanating from the saddle 5*2 to the left. Figures (a) and 
(b) demonstrate a consequence of the saddle connection S2 '-^ Si. a switching (as 
friction varies) of an attractor a direct transition rate from which is determined by 
the Arrhenius factor. 

3. Energy-coordinate plane. The solid line shows a 3-well potential U{q) (numbers in- 
dicate attractors, dots indicate saddles) while the dashed line shows a relaxational 
(noise-free) trajectory emanating from Si to the right. Figures (a) and (b) demon- 
strate a consequence of the saddle connection S2 ^ Si. a switching (as friction 
varies) of a saddle through which a fiuctuational transition into the attractor 3 
occurs if the initially occupied attractor is 1. 

4. Energy-coordinate (a) and phase (b) planes for the generalized Kramers problem. 
Thick solid lines show: (a) a potential curve E = U{q) = 0.06(g -|- 1.5)^ — cos{q) 
(potential of such type describes a r.f. SQUID - ^^), (b) boundaries of basins 
of attraction. Dots indicate: (a) local maxima of the potential {Si and 5*2), an 
intersection O of the horisontal line E = (dash-dotted line) with the potential 
curve E = U{q), and an intersection / between trajectories S2 2 and 2 

5*1, (b) saddles 5*1, 5*2. Thin sohd/dashed lines show the relaxational (for F = 
0.045) trajectories from S1/S2'. the trajectory from 5*2 goes to the well 2. Thick 
dotted/dashed line corresponds to the auxiliary relaxational trajectory (3.23), (3.28) 
with A = / ^ = The MP DTP 1 ^ S2 can be seen in the figure (a): it 
follows first the thin solid line 1 Si and then the dotted line Si^ S2. 

5. Energy-coordinate plane for a motion in the parabolic potential U{q) = q'^/2 (solid 
line): q = q — q{'2), E = {dq/dry /2 + U{q). (a). The dashed lines show asymptotic 
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noise-free trajectories (as well as time-reverse to them trajectories) at F = 2Q and, at 
the same time, indicate lines q/q — ±1. The dotted line shows an example of a path 
(3.45) which possesses a turning point to the left from the bottom of the well (only 
that part which corresponds to a motion preceding the turning point is shown since 
the motion following the turning point is not relevant), (b). The lines indicating 
the sewing conditions for r/(2Q) = 1 {q/q = ±1) and for r/(2Q) = a = 1.5 > 1 
{q/q — ice) ^-re shown by respectively thick and thin dashed lines. Examples of 
paths (3.54) with identical initial conditions but different V are shown by dotted 
lines: by the thick line for r/{2Q) = 1 and by the thin one for r/{2Q) = a. 

6. A dependence of an excess of action over the difference of energies, for an escape from 
1 to 5*2 in the potential shown in Fig. 4. The solid line is calculated numerically by 
(3.59) in which q^pt and r'{t) are calculated by the algorithm described in Sec. 3. 3.1. 
The dotted hne shows the exphcit underdamped asymptote (3.82), (3.83). The 
horisontal and vertical dashed lines indicate respectively the upper limit for AS'min 
and the lower limit for F at which the MP DTP 1 — > 5*2 does not exist. The inset 
shows an underdamped range in an enlarged scale. 

7. An example of a symmetric periodic potential (solid line) with more than one well 
within a period. Dashed lines show relaxational trajectories from higher barriers 
(indicated by dots). An escape to an adjacent period occurs most probable, for 
this concrete example, via the nearest high barrier, following the time-reverse re- 
laxational trajectory. If to apply a periodic force the most probable escape path 
may switch to the "more far'^ high barrier, thus, changing the direction of an initial 
noise-induced flux for the opposite one. 
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